Ai+ Training

Data Lake Technology provides a powerful way to process, refine, and present huge volumes of diverse data.  But the variety of technologies available presents unique challenges for start-ups and rapidly-growing companies and these large volumes of data come at a cost. As a Data Lake evolves, it grows in size and complexity. If not properly managed, a Data Lake can outgrow the abilities and resources of the team that manages it, negatively impacting the usefulness of an organization’s data and slowing or halting the team’s implementation of new analytics and applications. In this talk, Arjuna Chala, showcases how the completely free and open source HPCC Systems Data Lake platform has developed powerful storage and compute capabilities able to manage massive quantities of data as well as an open source data curation and governance system called Tombolo. 

Arjuna will discuss new and growing company platform case studies as well as how the system enables you to: 

- Achieve better performance, near real-time results and full-spectrum operational scale — without a massive development team, unnecessary add-ons or increased processing costs. 

- Curate data – the ability to automatically identify and classify a data file 

- Govern sensitive data – automatically identify sensitive data files, apply any necessary usage restrictions to that data 

- Keep accurate records - of who, how, and when a user or application interacts with a sensitive data file 

- Embed languages & integrate third party tools- including Spark, Mongo DB, Cassandra, Python and many more

Local ODSC chapter in NYC, USA