Bloomberg Senior Java / Big Data Engineer - Enterprise Content & Delivery in New York, New York

Job Requisition Number: 71337

This Enterprise Content & Delivery development team is responsible for building highly-performant distributed systems that manage large volumes of client data. We work with multiple groups within Bloomberg to gather millions of data points per day and develop tools to transform and store the data in an efficient manner for trend analysis, billing and business intelligence.

We are looking to enhance our software suite to develop a new automated data ingestion and analytics pipeline. We want every application that we on-board to define new schemas and leverage them for data ingestion. Secondly, we want to leverage or develop a framework that can provide for analysis against this data store and do this all in a manner that provides for operational independence. The right candidate will be expected to have extensive hands-on experience in Big Data Technologies such as Hadoop and HBase as well as frameworks like Apache Spark and/or Apache Kafka.

We'll trust you to:
  • Understand the capabilities of our current system and enhance it to support the capabilities of this new pipeline
  • Work with other groups within the organization to set up and configure big data clusters and assist with data volumetrics as well as hardware and software needs
  • Research, design and assist in building tools that can be utilized to analyze the data by internal users and support staff
  • Maintain systems to ensure they are highly available
You'll need to have:
  • 3+ years of current Java development experience
  • Proven experience with a range of big data architectures, including Hadoop, HBase or other big data frameworks
  • Experience building large scale distributed data processing systems
  • Solid understanding of data structures, algorithms & object-oriented design concepts
  • A passion for big data technologies and a flexible, creative approach to problem solving
  • Excellent communication skills
We'd love to see:
  • Experience with languages such as Python/Perl
  • Experience developing software using agile methodologies
  • Working knowledge of development tools such as debuggers, memory profilers, and performance analysis