There have been a lot of interesting predictions for what may happen in technology for 2016. Some friends at MongoDB told me their predictions. The Kafka and Container Orchestration ones seem dead on. For me I would add microservices will continue to be important and the Apache Spark will explode even more. I feel Scala, Go, Python will gain steam and Java will remain steady. A lot of cool new projects and technologies will come out that work in big data, cloud and devops. We’ll have to see.
- Data gets its seat on the board: CDO becomes a must-have title for Fortune 500
CIOs are focused on the infrastructure to process data. CDOs are tasked with making the organization see data as an asset: making that data accessible, managed and governed, and finding the balance between extracting value from data and mitigating the risk of breaches.
- The ever-growing rise of Kafka: Data streams join databases to power modern business apps
Kafka will become an essential integration point in enterprise data infrastructure, facilitating the creation of intelligent, distributed systems. With the growth of IoT, global deployments, and microservices, the need to capture and control in-flight data before it’s stored in a database is becoming more important. Kafka and other streaming systems like Spark and Storm will complement databases as critical pieces of the enterprise stack for managing data across applications and data centers.
- The Container Wars are over: the battle is on for Container Orchestration
Docker has clearly won the Container War, and everyone is now standardizing on it. Now the battle has shifted to container orchestration, and control of the data center is what’s at stake. There will be winners and losers, and some surprises. Interestingly, the winners will be the incumbent vendors – Red Hat and VMWare – who have figured out how to take the open source gifts from Docker and Google (Kubernetes), build them into their commercial products, and sell them to their existing buyers.
- Application performance bottlenecks shift from storage to the CPU and network
For more than a decade, performance bottlenecks have overwhelmingly been located in the storage tier. During that time CPU and network speeds have remained flat, which hasn’t been much of a performance issue since they tended to be waiting on the storage tier. With key innovations in storage – Intel’s 3D XPoint, a new form of NAND flash memory that increases density, endurance and performance, and NVME SSD’s superior and faster interface that bypasses the file system – the enterprise architect will now need to focus their efforts on optimizing applications at the CPU and network tier. As a result, application code will need to be optimized, and deployment architectures – like in-memory computing, as well as keeping copies of data near users across the globe – will become critical.