Applies data extraction, transformation and loading techniques in order to connect large data sets from a variety of sources. Creates data collection frameworks for structured and unstructured data. Develops and maintains infrastructure systems (e.g., data warehouses, data lakes) including data access APIs. Prepares and manipulates data using Hadoop or equivalent MapReduce platform. Responsible for adhering to company security policies and procedures and any other relevant policies and standards as directed.

 

Requires in-depth conceptual and practical knowledge in own job discipline and basic knowledge of related job disciplines.

Solves complex problems.

Works independently, receives minimal guidance.

May lead projects or project steps within a broader project or may have accountability for on-going activities or objectives.

Acts as a resource for colleagues with less experience.

Level at which career may stabilize for many years or until retirement.

 

Serves as an expert in the efficient and effective gathering and organization of data.

Experienced in cloud migration/building data pipelines on Cloud using Python and pushing data to BigQuery

Utilizes a strategic approach to plan for the use of complex data to create synergies across teams.

Selects appropriate analytical models and tools to analyze big data sets, develop business recommendations and support decision-making.

Develops and shares expert knowledge of customer's organization structure (e.g., geographies, business units), operations and business processes, and how they support the customer's strategic objectives, in order to identify customer needs

Identifies customer’s key decision makers and leverages an understanding of their unique perspectives and priorities when building relationships

Maintains thorough knowledge of customer’s industry, including key market and economic factors impacting business performance, as well as competitive landscape, in order to assist in creating effective customer solutions

Demonstrates an understanding of complex offerings and tailors solutions to meet the unique needs of the customer.

Demonstrates advanced understanding of products, technologies, offerings, etc. and coaches other colleagues in building their knowledge.

Leverages knowledge of competitors’ products and services as well as their strengths and weaknesses to compare choices.

 

Other Incidental tasks related to the job, as necessary.

Build Pipelines reading data from different sources like Postgress, Oracle into google cloud using Airflow and Bigquery

Build complex ETL code

Build complex SQL queries using MongoDB, Oracle, SQL Server, MariaDB, MySQL

Work on Data and Analytics Tools in the Cloud

Develop code using Python, Scala, R languages

Work with technologies such as Spark, Hadoop, Kafka, etc.

Build complex Data Engineering workflows

Work with team to solve a variety of problems using machine learning techniques, and implement cloud-based solutions for customers

Create complex data solutions and build data pipelines

Establish credibility and build impactful relationships with our customers to enable them to be cloud advocates

Capture and share industry best practices amongst the community

Attend and present valuable information at Industry Events

 

Basic conceptual knowledge on cloud Data platform Services and solutions.

Knowledge on ETL /ELT data pipelines on Cloud

Knowledge of building ETL /ELT data pipelines on Cloud: participate in code reviews, active player in building cloud data solutions hadoop ecosystem, RDBMS, DW/DM, learn from deep architectural discussions

 

Devises new methods and procedures for collecting data; performs complex data analyses and presents findings on the underlying principles, reasons or facts.

Utilizes knowledge and experience to perform data and database management responsibilities on multiple systems and to assist with policy and procedure development.

Demonstrates proper techniques for preparing and filing complex regulatory correspondence in an organized and concise format, sending documents to regulatory agencies as requested.

 

Bachelor's or Masters Degree in Computer science, Information Systems or related technical degree required

Certifications

Cloud certifications such as GCP Professional Data Engineer or Microsoft Data / AI certifications. 

Experience

5 – 7 years of experience in the field of role required.

 

General office environment: no special physical demands required. May require long periods of sitting and viewing a computer monitor. Schedule flexibility to include working weekends and/or evenings and holidays as required by the business for 24/7 operations. Must be able to lift 50 lbs over-head.                      

 

Occasional domestic/international travel, less than 50%

 

The above information has been designed to indicate the general nature and level of work performed by employees in this classification. It is not designed to contain or to be interpreted as a comprehensive inventory of all duties, responsibilities, and qualifications required of the employee assigned to this job.

The following information is required by the Colorado Equal Pay Transparency Act and applies only to individuals working in the state of Colorado. The anticipated starting pay range of Colorado applicants for this role is $81,600 –$105,800. Actual compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. Information on benefits offered is here