Description

We are looking for an enthusiastic and technology-proficient Big Data Engineer, who is eager to participate in the design and implementation of a top-notch Big Data solution to be deployed at a massive scale. Our customer is one of the world's largest technology companies with operations all over the world. On this project, we are working on the bleeding-edge of Big Data technology to develop a high-performance data analytics platform, which handles petabytes datasets.

Responsibilities:

• Participate in design and development of Big Data analytical applications

• Design, support and continuously enhance the project codebase, continuous integration pipeline, etc.

• Write complex ETL processes and frameworks for analytics and data management

• Implement large-scale near real-time streaming data processing pipelines

• Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at a massive scale

Requirements:

• Languages: Python, Scala

• Working knowledge of AWS

• Familiar with SQL and NoSQL databases

• Experience with data modeling

• In-depth knowledge of Hadoop and Spark, experience with data mining and stream processing technologies (Kafka, Spark Streaming, etc.)

• Understanding of the best practices in data quality and quality engineering

• Experience with version control systems, Git in particular

• Desire and ability for quick learning of new tools and technologies

Would be a plus:

• Knowledge of Unix-based operating systems (bash/ssh/ps/grep etc.)

• Experience with Github-based development processes

• Experience with JVM build systems (SBT, Maven, Gradle)

What we offer:

• Opportunity to work on bleeding-edge projects

• Work with a highly motivated and dedicated team

• Competitive salary

• Flexible schedule

• Benefits package - medical insurance, sports 

• Corporate social events

• Professional development opportunities

• Well-equipped office 

NB:

Can be fully remote but you will have to work in the US Pacific time zone.

Placement and Staffing Agencies need not apply.

About Us: 

Grid Dynamics is a leading provider of technology consulting, agile co-creation, scalable engineering, and data science services for Fortune 500 corporations undergoing digital transformation.

We work in close collaboration with our clients on digital transformation initiatives that span strategy consulting, early prototypes, and enterprise-scale delivery of new digital platforms. We help organizations become more agile and create innovative digital products and experiences using deep expertise in emerging technology, top global engineering talent, lean software development practices, and high-performance product culture.

Headquartered in Silicon Valley with over 1,300 technologists located in engineering delivery centers throughout the US, Central, and Eastern Europe, Grid Dynamics has architected and delivered some of the most extensive digital transformation programs in the retail, technology, and financial sectors to help its clients win market share, shorten time to market and reduce costs of digital operations on a massive scale.

To learn more about Grid Dynamics, visit www.griddynamics.com, or follow us on Twitter @GridDynamics.