Join online with today’s leading executives at the Data Summit on March 9th. Register here.
DataOps is a set of processes and techniques aimed at promoting a “culture of continuous improvement” in the field of data analytics. Proposed by Lenny Liebmann in 2014 for IBM’s Big Data and Analytics Hub, DataOps has matured into a holistic approach to data analytics from a collection of practices, including not only data preparation and reporting but all related information technology operations. According to a January 2020 report by 451 Research, 91% of companies already had a formal DataOps strategy – or were in the process of defining it, while 86% plan to increase or develop costs for DataOps over the next 12 months.
Imagine, Dataps can provide tools that an organization needs to deal with an increasing amount of data, for example streamlining database maintenance through automation. But the blockers stand in the way of fulfilling the promises of DataOps. In a separate survey published in August 2021, 451 research found that 90% of organizations do not have an “optimized” DataOps strategy and few believe they have achieved DataOps maturity.
Vendors like Atlan claim to simplify datapops by offering managed solutions that eliminate many of the complexities involved in deployment. For example, Atlan – who recently raised $ 50 million in Series B funding in Singapore (via DelStreetAsia) according to regulatory filing – does automated profiling of company data to identify outliers, missing values and discrepancies. It also combines business terms with data objects to generate a general understanding of the data and how to use it, stating how the data has evolved through its life cycle to predict how it will change going forward.
Atlan started as an internal initiative in the “Data for Good” firm SocialCops and was involved in more than 200 data projects, including India’s National Data and Analytics Platform and the United Nations SDGs National Data Platforms. By working as a hub of assets ranging from tables and dashboards to models and codes, the goal is to enable teams to create a source of truth while collaborating with data warehouses, chat apps like Slack and integration with business and data science tools.
After launching Social Corps in 2012, Prakalp Shankar and Varun Banka founded Atlanta in Singapore in 2018. Prior to teaming up with Shankar, Banka had a role in software engineering at Microsoft and served on Barclays’ operations and cross-product technology team.
“Today, data assets are not just tables, but codes, models, business intelligence dashboards and pipelines,” Shankar said in an earlier statement. “At Atlanta, we’re rethinking the human experience with data – why data assets can’t be shared as easily as a link to Google Docs, or if Google Analytics can tell you about usage on a website, why not? Not at all. Same for our data? “
Atlantis can be set up to send alerts to stakeholders in the event of a data problem. In-line chats and annotations obviously help users stay on the same page, such as Excel-type queries such as filters, aggregation and grouping on data from data leaks and warehouses. (Data Lake is a centralized repository for data stored in its raw format, while Data Warehouse collects data from a range of sources to provide business insights.) Database Content To search for personally identifiable (PPI) information and recommend descriptions for data in a database based on past data.
Challenges in DataOps
DataOps barriers can be challenging for many organizations, according to a 2021 survey by Data.World and DataKitchen. In the survey, sellers – who, it should be noted, have the motive behind giving the impression that DataOps are difficult to adopt – found that only 46% of companies consider their DataOps efforts to be both mature and successful. Respondents said data requests with data governance policies and unreasonable expectations have made their day-to-day jobs “very difficult.”
Shankar insists that Atlantean can help ease the burden on engineers – a sales pitch that obviously resonates with customers and investors. Atalan is used by teams from large enterprises such as Unilever, Scripps Health and Postman. And to date, Atlanta has raised $ 69 million in venture capital.
Salesforce Ventures and Sequoia Capital India participated in Atlan’s Category B, with Fintrackr estimating the company’s value to be approximately $ 452 million. Atlanta had earlier landed શ્રેણી 16.5 million in May 2021 in a Category A financing tranche.
Venturebeat’s mission Transformative Enterprise is about to become a digital town square for technology decision makers to gain knowledge about technology and transactions. Learn more