At Higher Ground Education, we are radically reinventing education. We believe that for a student to live their life fully, we need an education model that fosters independence and develops competent, capable, action-oriented thinkers and change agents. To achieve this, we are using technology as an enabler for the timeless core principles of Montessori education. We are committed to making high-quality, modernized Montessori education available to all. To that end, we are looking for a capable engineer for the following role.
As a Data Engineer, we are looking for a highly skilled career professional with real-world experience architecting big data pipelines. As a Data Engineer on our Data Operations team, you will design, build, and maintain Higher Ground's data and cloud infrastructure. You are responsible for driving the architecture and creation of a mission-critical, fast, and scalable cloud data pipeline platform to ensure trusted and uninterrupted data access to our systems. You will execute Higher Ground's data strategy. This position is full-time and remote.
Your Responsibilities:
- To design and build scalable infrastructure platforms to collect and process large amounts of structured and unstructured data in real-time.
- Make decisions regarding data storage, technology selection, organization, and solution design with software engineering and product management teams.
- Automate data pipelines, create data models, and monitor data systems.
- Conduct root cause analyses of performance, instability, and accuracy problems.
- Build and maintain data infrastructure.
- Create observability tooling to help other teams debug, understand, and tune their big data jobs and pipelines.
- Assist and mentor other teams with building and managing their data pipelines.
- Identify and write tools to automate processes and deployments.
Basic Qualifications:
- A bachelor's degree in a technical area with two years of hands-on professional experience.
- Working knowledge of cloud platforms and services, preferably AWS and Azure
- Experience with data processing frameworks like Spark/MapReduce and Storm
- Knowledge of data lakes and distributed data stores such as Snowflake, Delta Lake, Hadoop, BigQuery/BigTable, Redshift, and Minio
- Familiarity with querying tools like Athena and Presto
- Understanding of ETL/ELT tools like NiFi and Glue
- Deep understanding of relational and NoSQL databases, preferably Postgre and MongoDB
- Data orchestration and cataloging tools like Airflow, Kubeflow, Glue catalog, and Databricks Unity
- Hands-on, professional experience designing and implementing large-scale data pipelines processing terabytes of data
- Proficient with SQL, schema design, and data warehousing
- Experience working with queuing systems and stream processing patterns such as found in Kafka, BullMQ, and Celery
- Proficient in other programming languages such as Python and Javascript
- Excellent interpersonal and communication skills.
- Experience documenting processes and maintaining data records.
Preferred Qualifications:
- Acquainted with best practices in data analysis
- Experience with ETL operations with popular back-office applications like Salesforce, Stripe, Plaid, etc.
- Familiarity with data visualization tools like Tableau and PowerBI
- Familiarity with NodeJS and associated frameworks
- Experience with Agile development practices
We Offer:
- A competitive salary
- Health, dental, and vision insurance
- Paid time off and paid holidays
- 100% tuition discount for two children at any school within our network
- A network of supportive peers and mentors who regularly share best practices
- Career growth and promotion opportunities