Senior Data Management Professional - Data Annotation Operations and Quality
Bloomberg
Bloomberg runs on data. Our products are fueled by powerful information. We combine data and context to paint the whole picture for our clients, around the clock – from around the world. In Data, we are responsible for delivering this data, news and analytics through innovative technology - quickly and accurately. We apply problem-solving skills to identify innovative workflow efficiencies, and we implement technology solutions to enhance our systems, products and processes - all while providing customer support to our clients.
Our Team:
Data AI contributes to the building of Bloomberg’s AI-enhanced products at scale by curating model training data and enhancing how our internal processes use AI. By investing in AI at a strategic level, we expand our practice of engaging with AI to one that is embedded across Data. We encourage our internal processes to take advantage of new AI technologies and strengthen Data’s role in providing robust domain expertise and influential data artifacts to Bloomberg’s products. This way, our clients will continue to have high quality data and access to new types of datasets.
The Role:
A Senior Data Management Professional (DMP) is a key role within our organization responsible for providing subject matter expertise in both financial concepts and annotation program management, to the development of our AI products. These individuals act as proactive technical leaders by setting the framework in achieving quality and consistency in the evaluation and training datasets for models that power our AI-enhanced products, and delivering scalable governance in annotation program management across Bloomberg Data. Beyond governing data processes and being problem solvers, they are expected to transform the responsibilities of the team and scale the impact beyond what's possible today.
The role on the Code Generation Data team covers all annotation program components in developing the evaluation and training of AI models at Bloomberg. Being responsible for the annotation program to produce high quality annotated data and drive product outcomes will be a crucial part of the role, with key deliverables spanning ownership around task design, task routing, task instructions, consensus management, and reporting. The team is a critical partner in ensuring the stability and growth of the company which relies on bringing new technology to our clients with increased interests in Artificial Intelligence.
We’ll trust you to:
Develop and deploy data annotation projects
Design effective data annotation task and workflows
Maintain workflow configurations for critical existing annotation systems
Develop automated reporting systems for annotation projects to inform stakeholders of progress and quality
Apply data visualization skills to report on results of ongoing operations and projects proactively and when requested
Analyze current annotation processes to find opportunities to improve quality and velocity.
Partner with executing annotation teams to gather feedback and adjust processes as needed
Define and drive annotation governance and quality standards across cross-functional annotation initiatives
Partner with Engineering, Product, and team members, providing guidance and direction on annotation programs
You’ll need to have:
4+ years of professional work experience
Proven experience with development of data annotation programs and human-in-the-loop processes for AI/ML products
Fluency in Python & SQL
Experience customizing or developing annotation interfaces
Extensive experience in communicating and coordinating with internal and external partners while leading large-scale projects
Proven experience in data management concepts such as data quality, data modeling, and data engineering
Proficiency in being comfortable discussing technical concepts and experience evaluating trade-offs in design with Engineering, Product, and the broader data annotation team
Customer-focused approach and the ability to interact with a diverse range of clients
Proven ability to take a logical approach and apply critical thinking skills in order to tackle problems
Experience using data visualization tools such as Tableau, QlikSense, or PowerBI
Effective project management skills and ability to prioritize tasks accordingly
We’d Love to See:
Deep subject matter expertise within a chosen financial domain
Experience in semantic structures or data modeling
Experience with sophisticated data annotation or labeling initiatives at significant scale
Experience customizing or developing annotation interfaces using Javascript or HTML
Experience using open source data labeling platforms such as LabelStudio