NonStop SQL/MX a look back and forward
Many years ago, a company known as Tandem struggled to stay viable in the new world of client-server. This was in the mid-1990s, and the CEO of Tandem, Roel Pieper, was partnering with Microsoft, the main company driving client-server architecture. Microsoft was struggling to move up within the enterprise space. They needed a more robust platform and decided to provide a clustering option, code-named Wolfpack, to Windows. Several vendors contributed to Wolfpack, including Tandem, which became Windows clustering software. During this time, Tandem decided to do a major presentation with Microsoft and put together a demo called 2-Ton. This referred to a 2 Terabyte (in those days monstrous) database partitioned over 64 Windows servers.
The May 14th press release in 1997 stated: “Microsoft Corp. and Tandem Computers Inc. demonstrated the world’s largest Microsoft® Windows NT® Server network operating system-based system linking 64 Intel Pentium Pro processors in a cluster using Tandem’s ServerNet interconnect technology. The system managed a two terabyte database with a 30-billion row table that was based on Dayton-Hudson’s data warehouse, which manages retail outlets such as Target and Mervyn’s stores.” ServerNet had briefly been introduced as a networking card available for Windows servers. The following month, Tandem was acquired by Compaq Computers Inc. The database software used on the windows cluster was an early version of SQL/MX. It was released briefly for sale on Windows about six months after the Tandem acquisition. It was on the market for about four days before Compaq realized it was suddenly competing with its two biggest partners – Microsoft (SQL Server) and Oracle. Compaq pulled the database software from a stunned market. NT magazine had reviewed the product and stated it was five years ahead of SQL Server and at least 18 months ahead of Oracle regarding scale and reliability. Many supposed that Microsoft or Oracle were in secret negotiations to acquire SQL/MX, but the Windows product just faded from memory.
Of course, SQL/MP had been running on Tandem since the 1980s and was constantly improving. The database associated with Zero Latency Enterprise (ZLE) was another massive demonstration (at the time) utilizing 110 terabytes partitioned across a 128-processor NonStop system. Not too long after the ZLE demonstration, Compaq was acquired by HP. HP implemented its own ZLE system to integrate the two SAP environments existing in Compaq and HP. The SAP instances were integrated across both companies in real-time. The system was known as iHub and was a 16-processor NonStop. It won numerous awards from the Winter group in 2005. These included 1st place in the World’s Largest Event Store, 1st place in the World’s Busiest Event Store, 2nd place in the World’s Most Rows Scientific, Other (Not OLTP, not DW), and 4th place in the World’s Largest Database Overall. Not bad.
About that time, the mayhem caused by Y2K was about over, and Venture Capital firms started investing again in startups. One of the more popular startups were data analytic companies. Small database appliances that could load data quickly and allow analytics to start against the data almost as soon as it was loaded. Companies like Netezza, Datallegro, and many others were suddenly in the market, challenging Oracle, Teradata, and IBM or at least making inroads into accounts with quick and easy data analysis. All these new solutions were based on a massively parallel, shared-nothing architecture. The R&D folks inside NonStop felt they could launch a database appliance product quickly since we already had a massively parallel, shared-nothing architecture. They also dusted off SQL/MX as the database they wanted to use on this new appliance. A short time later, the system code, named Neo, was being tested in the NonStop labs. It was designed to compete with the other startup appliances but had the distinct advantage of a tried and true database with a large company (not VC money) behind it. This was about the time Mark Hurd became CEO of HP. Mark had led Teradata and knew all about Tandem/NonStop. He quickly learned of the Neo Skunkworks project and wanted to know more. Neo was tested against the Walmart database benchmark and fared very well. Mark felt Neo should become an enterprise data warehouse (EDW), not a database appliance, so the direction was changed, money was invested, and Neoview (Actual Product name) was released into the market.
Mark Hurd also wanted HP’s IT to create an EDW using Neoview, and Randy Mott, the CIO at the time, was tasked with migrating a decentralized 700+ data mart environment into a single EDW. His bonus was based on getting this, and many other things, accomplished in three years. He was successful. Neoview, running a superset of SQL/MX, was the EDW for HP for many years, even after Neoview was, let us say, decommissioned. After the tumultuous exit of Mark Hurd from HP, executives, perhaps bitter over Mark’s tenure and leadership, killed Neoview in what seemed to be an ill-conceived plan to ‘get back at Hurd.’ Neoview was coming into its own in terms of performance and stability when the end of sale was announced suddenly. I say ill-conceived because there was no migration plan for customers. It appeared that HP was simply getting out of the Big Data and analytics business just as it was catching on fire. Randy Mott picked up the Neoview resources since he had an EDW to run and maintain, even if it was now EOL (End-Of-Life). It took many years, but a combination of Vertica and Hadoop eventually replaced the Neoview EDW. It was bad news for Neoview, but the many additions created to support the massive HP EDW have been incorporated back into the NonStop SQL/MX of today, and that is very good news for customers taking advantage of our very robust database.
Back in the early days of Neoview, it supported many of the Teradata commands. Today, SQL/MX has been expanded to support Oracle database compatibility and make migrating databases onto NonStop easier. Should you consider such a migration?
From a capital expense standpoint, would running the application on NonStop be less expensive, or would you keep it where it is? In the case of migration to NonStop, you should think of mission-critical, high-volume, or databases that need to scale to take full advantage of NonStop. If we compare Oracle RAC systems, which are expensive, complicated, and require specialized DBA, the costs are lower, the configurations are easier, and the staffing is less on NonStop.
Many open-source databases claim mission-critical capabilities, but the question is at what price and effort? With many vendors and open-source databases, you often need to go back to the drawing board before you move to mission-critical availability and from scale up to scale out. Those changes often need very specialized DBAs who can rarely satisfy the complex needs of different applications. With open-source databases, while the initial cost may appear lower, costs will quickly rise as you design and assemble the final solution, making sure to avoid single points of failure. Adding on availability and scale after the fact is costly and adds to complexity, which is the enemy of availability.
Additionally, if the database grows in a scale-out fashion, there is a predictable cost for growth and a linear expansion to the NonStop system and the database. NonStop SQL/MX uses local lock managers, which is part of the shared-nothing architecture and provides the linear scale. With its central lock manager, Oracle has created a bottleneck to scale. Adding nodes to RAC does not increase the performance like adding nodes to a NonStop does. If you plan to grow, the best performance increase with the best-predicted cost is with NonStop.
When I was working on the Neoview systems, I happened to be working on an internal project with an HP Oracle specialist who had successfully competed against Teradata. Since he and I both worked for HP, he was telling me about the benchmarks he had conducted for HP using Oracle. “Teradata, like Neoview (NonStop), comes pretty well configured out of the box. When Teradata would set a benchmark, they would almost always be faster than Oracle, but we’d spend 6 to 8 weeks tuning Oracle, and we’d usually be able to beat the Teradata performance eventually. With a known query load, we can tune Oracle really well. The problem, in real life, is that the query loads rarely remain static. When they change, you need to retune Oracle for good performance. If your query profile changes a lot, a system like Neoview (NonStop) is much easier to tune and delivers overall better performance.” That story also demonstrates the difference in staffing requirements. As another database professional said, “Oracle has a lot of bells, whistles, and buttons to push. You can eventually tune a system really well, although tuning is continuous. On Nonstop, there’s just not that many things to muck around with.” In many studies, the staff required for NonStop is always less than the staff required for competitive offerings.
As most know, NonStop is rated at the IDC availability level 4 tier. That is the highest tier for availability and states that when a failure occurs on an AL4 system, the users are unaware of the failure. NonStop is not the only vendor with this rating, but there is a difference. For IBM and Oracle AL4 systems, IDC indicates very specific configurations that are considered AL4. NonStop is the only major vendor that provides AL4 out of the box. Also, in terms of actual availability, NonStop has higher availability in the industry. According to Gartner, IT downtime costs $5600/min but up to $50,000/min for Fortune 500 companies. According to IDC Financial Services and TELCO are the industries where downtime is most costly. While everyone claims to have high availability features, very few offerings are able to achieve 99,999% availability (5 minutes of downtime per year). In fact, the majority of platforms using high availability features hope to achieve at best 99,99% availability, therefore 50 minutes of downtime per year. So, there is a delta of 45 minutes between the 99.99% and 99.999% of availability. If we multiply the 45 minutes by the $50,000 per minute of downtime cost, it is over $2,000,000. If you know your downtime costs, you can determine your own numbers.
NonStop SQL/MX has a long history. From the real-time operational data store (ZLE) days to the Enterprise Data Warehouse (Neoview), SQL/MX has proven it is both available and massively scalable. When we make accurate cost comparisons, NonStop is generally less expensive than its competitors. It is much simpler to set up and run, letting you get to production faster, all while requiring less staffing. Besides all that, it has a proven track record of being the most available system and database in the market. New features, open-source capabilities (DevOps), and API support are included and enhanced with every release. Please consider NonStop SQL/MX when you need an available, reliable, and scalable database for your next application.