Data lake is the centralized storage repository that holds a vast amount of raw data in its native format. Our data lake helps us break down information silos, minimize risk of data loss and miscategorization, and analyze and share data across our company. This data can be readily projected into appropriate technologies for consumption or transformation. Data Lake uses a wide variety of cutting edge technologies including Hadoop, HBase, HDFS, Map/Reduce, Spark, Apache Beam, Apache Flink, Kakfa, SQL data warehouses, Presto, Hive, Java and Python.
The User Engagement and Product Management team engages the firm’s Engineers (our users) to understand their big data needs, educate them on the Lake’s features and functionality, provide technical support and manage the product roadmap. The team is functionally knowledgeable about the Lake’s current and planned features as well as technically adept at identifying and resolving simple issues in the codebase. They are responsible for developing analytics on user’s Lake usage, configuration/software behavior, data patterns and issues in order to better understand, serve and proactively manage our users. In addition, the team builds tooling and training solutions to facilitate quicker resolution of user requests, independent learning of the Lake’s functionality and to promote self-service.
HOW WILL YOU FULFILL YOUR POTENTIAL?