BMC

Houston, TX
5,001-10,000 employees
BMC helps customers run and reinvent their businesses with open, scalable, and modular solutions to complex IT problems.

Principal Data Engineer

BMC

Principal Data Engineer

This job is no longer open

Description and Requirements

From core to cloud to edge, BMC delivers the software and services that enable over 10,000 global customers, including 84% of the Forbes Global 100, to thrive in their ongoing evolution to an Autonomous Digital Enterprise.

The BMC Innovation Labs brings together customers, partners, and employees to accelerate the development of new and relevant solutions that create value. Our goal with our innovation labs team is to harness new ideas, to anticipate and act on market changes by:

  • Fostering innovation by creating spaces for experimentation

  • Advancing ideas that generate disruptive technologies

  • Accelerating prototyping and development of new capabilities

It is through this collaborative environment that we explore how new technologies can be leveraged to bring market differentiating value to customers through our next generation solutions. We help clients pivot from thinking digital to being digital at the core.

From big data analytics, to cognitive digital twins and data driven strategy consulting and startup acceleration we work to make our customers even more successful. Join us in our accelerated journey.

Position Description:

We are looking BMC Is looking for a savvy Data Engineer to join our growing team of data experts. The individual will be responsible for developing solutions that expand and optimize customer’s data pipeline architecture, as well as optimize data flow and collection for cross functional teams.

The ideal candidate should have these characteristics:

  • Self-starter that requires minimal oversight yet demonstrates consistent involvement with flexibility and good follow-through skills. 

  • Enthusiastic about managing challenging projects across multiple teams and locations.

  • Comfortable marshaling large amounts of data to make decisions and build business cases.

  • Shares BMC's passion for the customer

  • Embraces change and works well in a fluid environment

  • Ability to operate and communicate at all business levels

  • Expects, requires and demonstrates continuous innovation

  • Results oriented

  • Ability to think big and to inspire passion in others

Primary Roles and Responsibilities:

  • Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.

  • Assist in the migration of Database platforms

  • Create data pipelines for batch, micro-batch, and real-time data streams.

  • Assemble large, complex data sets that meet functional / non-functional business requirements.

  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.

  • Build tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

  • Create data tools for our data scientist team members that assist them in building and optimizing our product into an innovative industry leader.

  • Data cleansing and data wrangling to prepare structured and unstructured data for various modes of consumption including Artificial Intelligence, Machine Learning, statistical models, dashboards, etc.

Must-have experience/criteria for role:

  • Self-starter requiring minimal oversight, demonstrates consistent involvement with flexibility and good follow-through skills.

  • Excellent problem solver and out-of-box thinker

  • Must have participated in full product development lifecycle of software products (whiteboard to production) and successfully brought deliverables to market. 

  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.

  • Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

  • Strong analytic skills related to working with unstructured datasets.

  • Build processes supporting data transformation, data structures, metadata, dependency and workload management.

  • A successful history of manipulating, processing and extracting value from large disconnected datasets.

  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

  • Fast learner that can quickly synthesize ideas, information, and options into a strategy, plan, or response and effectively communicate it

Technical Skills

  • Big data tools: Hadoop, Spark, Kafka, etc.

  • Relational SQL and NoSQL databases

  • Scripting languages: Python, Java, C++, Scala, etc.

  • Experience working with AWS / Azure / GCP as well as building and optimizing ‘big data’ pipelines, architectures, and data sets

  • A track record of shipping successful software products.

#LI-Remote

It is the policy of BMC Software to afford equal opportunity for employment to all individuals regardless of race, color, age, national origin, physical or mental disability, history of disability, ancestry, citizenship status, political affiliation, religion, gender, transgender, gender identity, gender expression, marital status, status as a parent, sexual orientation, veteran status, genetic information or other factors prohibited by law, and to prohibit harassment or retaliation based on any of these factors. BMC never asks for payment from individuals seeking employment with the company.

If you need a reasonable accommodation for any part of the application and hiring process, visit theaccommodation request page.

This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.