Senior Software Engineer - Archive Metadata

Company: Avature
Location: New York
Posted on: February 16, 2025

Job Description:

Senior Software Engineer - Archive MetadataLocation: New YorkBusiness Area: Engineering and CTORef #: 10041200Description & RequirementsWith ever-increasing channels of communication and heightened regulatory scrutiny, organizations need to continuously archive and monitor their activities and data. Our clients seek a one-stop shop for compliant storage and reconstruction of communication, collaboration, and financial transaction information. That's where Bloomberg Vault (BVAULT) steps in. Thousands of organizations trust BVAULT to manage and archive their enterprise communications and trade data, including Bloomberg Message, Instant Bloomberg, email, instant messages, mobile data, files, voice data, social media, and more.As a Senior Software Engineer within the BVAULT Archive Metadata team, you will be pivotal in designing and implementing systems that harness metadata to unlock the full potential of the petabytes of data we collect. Metadata plays a key role, not just in organizing data, but in understanding how it moves through systems, uncovering valuable insights, and enabling advanced analytics using AI/ML. You will work with state-of-the-art tools to ensure our datasets are optimized for analysis and reporting, empowering the business to make faster, more informed decisions.In this role, you'll also be at the forefront of applying metadata to the next generation of cutting-edge applications such as trade reconstruction and surveillance, where it provides essential context and structure for more accurate model training. By leveraging metadata, we solve complex business challenges, driving innovation and value at scale. As part of this dynamic and young team, you'll have the opportunity to shape the future of this critical infrastructure from the ground up.Key Responsibilities:

• Build scalable, distributed data ingestion and processing pipelines.
• Develop data models and architecture for data lakes.
• Optimize data retrieval for dashboards and reporting.
• Ensure compliance with data governance and security standards.
• Collaborate with stakeholders to deliver data-driven solutions.
• Monitor performance and recommend infrastructure improvements.You'll need to have:
• 4+ years of experience as a Data Engineer, Software Engineer, or similar role.
• 4+ years experience with SQL, Python, Java, or C++.
• Strong skills in distributed systems and open-source technologies.
• Excellent problem-solving and communication skills.
• A Degree in Computer Science, Engineering, Mathematics, similar field of study, or equivalent work experience.We'd love to see:Experience with open-table formats (e.g., Parquet), cloud platforms (e.g., S3), and technologies like Apache Iceberg, Spark, Kubernetes, and Airflow/Argo.Why Join Us?Our team prioritizes maintaining a healthy work-life balance through clear communication and setting realistic project timelines. We foster a supportive environment that allows our engineers to thrive both personally and professionally. Additionally, we dedicate four weeks at the end of the year for "Innovation Month," where team members are encouraged to collaborate on engineering-driven projects and explore new technologies.Salary Range = 160000-240000 USD Annually + Benefits + BonusThe referenced salary range is based on the Company's good faith belief at the time of posting. Actual compensation may vary based on factors such as geographic location, work experience, market conditions, education/training, and skill level.We offer one of the most comprehensive and generous benefits plans available and offer a range of total rewards that may include merit increases, incentive compensation, [Exempt roles only], paid holidays, paid time off, medical, dental, vision, short and long-term disability benefits, 401(k) + match, life insurance, and various wellness programs, among others. The Company does not provide benefits directly to contingent workers/contractors and interns.
  #J-18808-Ljbffr

Keywords: Avature, New York , Senior Software Engineer - Archive Metadata, IT / Software / Systems , New York, New York