Date Posted
Category
Salary
Job type
Work model
Level
Location
Unfortunately, this job posting is expired. Please click here to view related job postings.
Company

BloombergSee more

addressAddressNew York, United States
CategoryEngineering

Job description

About Us
The AI Group is the central engineering group responsible for driving Machine Learning (ML) adoption at Bloomberg, with 200 researchers and engineers working together to provide clients with the best-in-class news, research, market data, and analytics using state of the art machine learning technology. We directly impact a wide variety of Bloomberg's flagship products, including news, research, pricing, our communications platforms and search and discovery tools. We work on a variety of ML disciplines, including natural language processing, information retrieval, time series analysis, and recommender systems.

What We Do
What sets our group apart is end-to-end ownership of our models and services, which are distributed, high-throughput and low latency systems that are collectively called billions of times a day. In order to deliver at such scale, we are building platforms that enable our application-focused ML engineering teams to go from an idea to a model to a scalable service with minimal overhead. We also offer higher-level abstractions and UIs to enable domain experts to easily build, deploy and maintain production ML models for their applications in a self-service manner, with little engineering intervention.

What We Need From You
While working on the team as a Senior Data Engineer, you will have the opportunity to enhance our data pipelines and platforms that enable machine learning tasks. You will work with application, product, platform, and infrastructure teams to extract data from Bloomberg's vast data ecosystem and prepare it for analyzing, annotating, training, evaluating, serving, and other tasks. Typical activities include:

  • Work with application and product teams to define data needs and SLAs
  • Design, build, and deploy resilient, monitorable pipelines to transport and store data in various storage solutions
  • Identify the appropriate storage solutions and for a given use case, understanding the tradeoffs in performance, cost, and complexity
  • Model datasets with idiomatic schema design, tailored for a dataset's intended use
  • Design and implement efficient data retrieval and processing solutions suited for our ML environments
  • Collaborate with platform and infrastructure teams to influence the direction and support of various managed solutions

Colleagues who excel in this role often exhibit these qualities:
  • Experience with message queueing systems like Kafka
  • Proven track record building ETL pipelines leveraging technologies such as Kafka Streams, Kafka Connect, Flink, or Spark Streaming
  • Prior experience building or extending data lakes, using various storage, cataloging, and retrieval technologies such as S3, HDFS, Hadoop, HBase, Hive, Trino, Presto, Cassandra, Spark
  • Instruments their pipelines, and is able to quickly pinpoint problems from dashboards and logs
  • Proficiency in a programming language such as Scala, Java, or Python, and a willingness to learn new languages
  • Familiarity with an workflow orchestration technology, such as Argo, Airflow, or Oozie
  • Excellent communication skills and a willingness to collaborate with various stakeholders

This position requires at least one of the following:
  • A bachelor's degree in computer science or a related field, and/or
  • An equivalent combination of education, and/or
  • Specialized training, and/or
  • Related professional experience.
Bloomberg is an equal opportunity employer and we value diversity at our company. We do not discriminate on the basis of age, ancestry, color, gender identity or expression, genetic predisposition or carrier status, marital status, national or ethnic origin, race, religion or belief, sex, sexual orientation, sexual and other reproductive health decisions, parental or caring status, physical or mental disability, pregnancy or parental leave, protected veteran status, status as a victim of domestic violence, or any other classification protected by applicable law.

Bloomberg is a disability inclusive employer. Please let us know if you require any reasonable adjustments to be made for the recruitment process. If you would prefer to discuss this confidentially, please email access2@bloomberg.net


Refer code: 294540. Bloomberg - The previous day - 2022-10-06 06:30

Bloomberg

New York, United States
Jobs feed

Registered Nurses |Port Augusta Prison

Sa Health

Port Augusta, SA

$72,651-99,129 per year

Locum Consultant Anaesthetist

Jon & Jon Medical

Whyalla, SA

Permanent

Restaurant Manager - Whyalla

Hungry Jack's

Whyalla, SA

Permanent

Sales Assistant - Casual - Just Jeans - Mount Gambier

Just Jeans

Mount Gambier, SA

Permanent

FOH/Bar Attendant (Casual)

Matthews Hospitality

Mount Gambier, SA

Permanent

TEMPORARY TEACHER - GORDON EDUCATION CENTRE (MOUNT GAMBIER) - SPECIAL EDUCATION / PRIMARY

Department For Education

Mount Gambier, SA

$74,769-108,441 per year

Maintenance/Handyperson (Causal)

Matthews Hospitality

Mount Gambier, SA

Permanent

Nurse Consultant - Intensive Community Program

Government Of South Australia

Whyalla, SA

$121,537-126,970 per year

Dispensary Technician/Webster Packer Full Time

Scaffidi

Whyalla, SA

Permanent

APS6 Fraud Investigator

Chandler Macleod

Adelaide, SA

$60.26 per hour

Share jobs with friends

Related jobs

Artificial Intelligence Group - Data Engineer

Data Engineer

Paxus

Contract

Belmont, WA

just now - seen

SQL full stack BI Engineer/ Data Engineer

Finite Recruitment

$125-126 per day

Western Australia

3 hours ago - seen

Data Engineer

Peoplebank

Perth, WA

7 days ago - seen

Principal Data Engineer

Office Of The Auditor-General Wa

$110,309 - $121,569 a year

Perth, WA

7 days ago - seen

Senior Data Engineer

Jacobs Solutions Inc.

Perth, WA

7 days ago - seen

GIS Data Engineer

Southern Ports

Bunbury, WA

a week ago - seen

GIS Data Engineer

Southern Ports Authority

Perth, WA

a week ago - seen

Data Engineer - Big Data

Commonwealth Bank

Perth, WA

a week ago - seen

Lead Data Platforms Engineer

Fortescue Metals Group

Perth, WA

a week ago - seen

Data Engineer

Aviva Plc

Perth, WA

a week ago - seen

Senior Data Engineer

Oui Recruitment

Perth, WA

a week ago - seen

Principal Data Engineer

Western Australia Government

Perth, WA

a week ago - seen

GIS Data Engineer

Southern Ports

Albany, WA

2 weeks ago - seen

GIS Data Engineer

Southern Ports Authority

Western Australia

2 weeks ago - seen

GIS Data Engineer

Southern Ports Authority

Albany, WA

2 weeks ago - seen

GIS Data Engineer

Southern Ports

Esperance, WA

2 weeks ago - seen

Technical Support/Data Engineer

Fti Consulting, Inc.

Perth, WA

2 weeks ago - seen

GIS Data Engineer

Southern Ports Authority

Western Australia

2 weeks ago - seen