StreamSets, Inc.: Data flow performance management software.

It has been facilitated by the company’s Data Collector product, that was often embedded by ISVs in their own products.
Since 1969, it has helped 10,000+ organizations use software for connecting people, departments, systems and devices.
Software AG empowers truly connected enterprises using integration & APIs, IoT & analytics and business & IT transformation.
Software AG’s products establish a fluid flow of data that allows everything and everyone to work together.
The company has more than 4,800 employees across more than 70 countries and annual revenue of over €800m.
It is committed to its ambition of exceeding €1 billion of organic revenue and reaching an organic operating profit percentage (EBITA, non-IFRS) of between 25% to 30% in 2023.
An important principle for us has been that there is only one fully-featured version of the open source StreamSets Data Collector.

The company has had the opportunity to automate data onboarding and dataflow maintenance, plus add a huge selection of data sources with their data lake in just a matter of weeks.
Automating dataflows using StreamSets Data Collector lowers their data engineering costs and provides the company a platform to become truly data-driven.
StreamSets announced a beta release for its new cloud offering, StreamSets Cloud.
Its namesake cloud data integration platform aims to eliminate the guesswork of open source and hand-coding with something tailored to handle variables that include ingesting and transforming modern data types.
Rather than just provide a platform for streams and stream processing, StreamSets allows data teams to establish and track operational KPIs for data flows, and can alert operations personel when performance degrades.

Connectivity to all systems within an enterprise, both legacy and modern, is crucial.
Stream sets can be an open source software for building any-to-any batch and any streaming data flows.
It really is deployed on edge, on cluster or in could to move data from big data sources to varied destinations through smart pipelines.

[newline]This is compared to the old world of, let’s say, business intelligence, where everything could possibly be thrown right into a SQL database.
Here we discover that there’s a small amount of machine learning, maybe there’s a little bit of Spark, there’s a little bit of SQL.
Maybe people are throwing data right into a system to create search indexes.

Then it measures the day-to-day operations of the topologies, and finally lets you master their performance by implementing service level agreements that make sure you are always delivering timely and trustworthy data.
This industry has been focused historically on the developer side of the data movement and integration problem.
But in this modern of streaming data and real-time analytics, it’s critical to manage the quality of the data flows on a continuous basis.

Spring Cloud Data Flow

StreamSets software delivers performance management for data flows that feed the next generation of Big Data applications.
Its mission would be to bring operational excellence to the management of data in motion, in order that data continually arrives on-time and with quality, empowering business-critical analysis and decision-making.
The advent of NPM and later APM were direct outcomes of enterprises paying keen attention to which assets within their business were actually driving value and then optimizing for the performance of these assets.

Cloud is actually just more of an economic model to allow them to being able to burst and reduce maintenance costs.
Workload portability allowing the data to move to the best place to run the work will be an extremely common requirement.
We had this vision of creating an operations product — what we call dataflow performance management, or DPM.
Think of it as the equivalent of what New Relic and AppDynamics did for app operations.
So we didn’t have any worries about not having the ability to be monetize effectively.
It will come as no surprise to those among us who eat, sleep and breathe data that Girish Pancha and Arvind Prabhakar are at the helm of the growing force in DPM.
With over three decades of combined experience including key positions at Informatica and Cloudera, these founders know just what the real pain points in the market are and exactly what is needed to solve them.

Similar To Bad Data Is Polluting Big Data (

Orange Logic’s dedication to flexibility and useability has generated a highly intuitive experience made to meet and exceed every departmental need, maximizing company-wide user adoption and unlocking workflow efficiencies at scale.
You might suspect we wouldn’t be discussing this without a shiny new startup inside our portfolio, and you’d be right.
We are thrilled to announce our investment today in StreamSets—a company which has the foresight and execution horsepower to generate and shape the brand new data performance management market.
At its core, StreamSets is a specialized solution comprising a couple of low-footprint, low-latency components that forge the lowest-friction path so you can get data from source to consumption.
One StreamSets Fortune 500 customer in the automotive industry has utilized StreamSets Data Collector’s new features to create an enterprise-wide data exchange providing universal access across dozen of business units.

• It supports 100M concurrent IoT device connections per cluster while maintaining extremely high throughput and sub-millisecond latency.
• When we connected, we came to the realization that a number of disruptions around big data, open source, etc., could provide us a chance to take action meaningful in the info middleware and data integration space.
• Solutions Review brings all of the technology news, reviews, guidelines and industry events together in one place.
• Getting ubiquity for our data-collection technology was all important, so we thought right from the start, “How do we get the word out?
• More companies are building pipelines to fuel their next-generation analytics projects, said Clarke Patterson, StreamSets’ product marketing executive, making business intelligence more pervasive throughout their organizations.
• StreamSets Data Performance Manager will undoubtedly be generally available later this month, initially as a cloud-based service, with special pricing designed for early customers.

Know more about how StreamSets might help your organization harness the energy of data.
Agarwal says that while everyone really wants to run Big Data technology, people are lost in managing it.
The effect, when something goes wrong, is everyone picking through logs and crudely testing theorized diagnoses before problem is remediated.
Drag-and-drop data-flow design — Identical to StreamSets Data Collector, pipelines are built using origin, destination and transformation objects, with the choice to plug in scripts and trigger custom code execution.
Platform-independent — Predicated on Go, SDC Edge runs on a broad range of operating systems, including Linux, OS X, Windows and Android.
Actually, we surveyed our community a few months ago about how folks are utilizing the open source software.

Rick Whiting has been with CRN since 2006 and is currently a feature/special projects editor.
Whiting manages many CRN’s signature annual editorial projects including Channel Chiefs, Partner Program Guide, Big Data 100, Emerging Vendors, Tech Innovators and Products of the entire year.
StreamSets Data Performance Manager will be generally available later this month as a cloud-based service with special pricing available for early adopters.
Data fueling your organization today comes from a wide range of internal and external sources.
The framework can decrease the attack surface, manage risks, and allow secure data-sharing for partnerships, the Department of Defense noted.
From fixed-wireless access use cases to open access networks, the past year was deep with attempts to bridge the digital divide.
The San Francisco-based company was founded in 2014, and has raised $67.5M through its latest Series C funding round.