R

Data Engineer

Data Engineer

This job is no longer open
Remine is transforming the real estate industry with our intense focus and commitment to data.  By merging property listing, financial, consumer, public record, and geospatial data we are propelling the industry into the future. A core expectation for our Data Engineers is to strengthen today’s foothold while keeping a steady gaze on the future.  This means being able to delight customers with a nimble tactical approach while overlaying your experience in building enterprise grade data pipelines with inherent scale and quality. Our core platform and data products deliver powerful insights and predictive analytics on top of our geospatial applications. We build products for both web and mobile to deliver visualizations and search capabilities for real estate agents, brokers, and experts. Our platform and products support large-scale data sources, processing near-real time updates from a large number of sources.  With structured and semi-structured data, our data ingestion pipelines, data processing capabilities, and extensive front-end displays provide our users globally the capability to search, label, and track changing datasets as they come in for the real estate arena.

Mindset

    • Look both ways before you cross the street (i.e. planning is paramount)
    • Always leave the campground cleaner than you found it (i.e. commitment to quality & testing)
    • Talent wins games, but teamwork and intelligence wins championships (i.e. accountability to team over self)
    • Nostalgia is an illness for those who haven't realized that today is tomorrow's nostalgia (i.e. no decision is sacred)
    • Not only our actions but also our omissions become our destiny (i.e. transparency ensures effective development)
    • Control leads to compliance; autonomy leads to engagement (i.e. anti-ivory tower leadership model)

Responsibilities

    • Build scalable, durable and fault tolerant data pipelines on a modern data stack built on AWS
    • Build prototypes for future data integration and architecture patterns
    • Help troubleshoot ongoing production issues and implement long term fixes
    • Build an overarching monitoring and observability framework
    • Manage Remine’s querying platform and experimentation tools
    • Implementation of security and data protection 
    • Work with analysts, data engineers and data scientists to Identify, design, and implement internal process and standards improvements: standardized tools, automating processes, optimizing data delivery, etc. 
    • Design infrastructure and systems to scale easily as data grows. 
    • Optimize Remine’s spark processing pipelines and clusters, ensuring high-quality data is securely and reliably delivered to stakeholders. 

Essential Skills

    • Experience with big data technologies such as Spark, Hive, Kafka, etc. 
    • 2+ years of hands-on experience with AWS.
    • Advanced working SQL knowledge and experience (Postgres, Hive, Snowflake etc) is required, No-SQL experience is a plus; 
    • Familiarity with enterprise integration patterns and ability to follow accepted software design patterns 
    • Passionate about thorough application testing 
    • Expert at sourcing and manipulating data from APIs 
    • Experience with Elasticsearch or other search technologies
    • DevOps mindset with Docker experience in Kubernetes or ECS
    • 1+ years with Python or Node for ETL development 
    • 2+ years of hands-on technical experience in a data engineer role
This job is no longer open
Logos/outerjoin logo full

Outer Join is the premier job board for remote jobs in data science, analytics, and engineering.