EXECUTIVE SUMMARY OF RESPONSIBILITIES
Would you like to work in a fast-paced environment where your technical abilities will be challenged on a day-to-day basis? If so, Lendistry’s data team is seeking a Senior Data Engineer to build high quality, scalable and resilient solutions that empowers the business. Our data warehouse caters to a wide variety of real-time, near real-time and batch analytical solutions. These solutions are integral part of business functions like Sales, Operations, Finance, Marketing, and Technology, enabling business drivers to make critical decisions. We utilize modern data stacks born in the Cloud. Designing, developing, and scaling these big data technologies are a core part of our daily job. The ideal candidate for this position, should have passion for data, be proficient in programming and should have passion for building analytics solutions to enable the business to make time sensitive and critical decisions.
ABOUT LENDISTRY
Lendistry is the country’s largest minority-led and technology-enabled small business and commercial real estate lender with Community Development Financial Institution (CDFI) and Community Development Entity (CDE) certification. We are a national employer whose mission is to provide economic opportunities and progressive growth for small business owners and their underserved communities as a source of financing and financial education.
GENERAL RESPONSIBILITIES
Design, implement and maintain data pipelines, both batch and real-time that produces reliable data for various data consumption use cases.
Design implement and maintain data tools to ensure data quality, data governance and data compliance.
Help manage the data warehouse and the various sources of data (Salesforce, ERP) that feed the warehouse.
Build and own the automation and monitoring frameworks that showcase reliable., accurate, easy to understand metrics and operational KPI's to stakeholders and data pipeline quality and performance.
Be the SME for the data, pipeline design, and other related big data and programming technologies.
Build and maintain data marts for various business needs
Evaluate various technologies and platforms in open source and proprietary products. Execute proof of concept on new technology and tools to pick the best tools and solutions.
Understanding data governance practices such as metadata management, data lineage, and data glossaries is a huge plus.
Foster strong collaboration between globally distributed team members.
Harness operational excellence and continuous improvement with a can-do attitude.
PROFICIENCIES
Experience with Cloud-based warehouses is a requirement.
Solid understanding of RDBMS concepts, data structures, and distributed data processing patterns.
Expertise in programming pipelines in languages like Python, Scala, Java etc.
Experience with Cloud technologies like AWS
Experience with version control systems (Github, BitBucket, etc..) and CI/CD tools.
Experience in data orchestration and scheduling tools like Airflow
Proven track record of building products on some production -grade systems.
EDUCATION AND EXPERIENCE
BS degree in Computer Science or related technical field, or equivalent practical experience
Experience working in a fintech industry a definite plus but not required.
Must have a strong experience with data infrastructure, data architecture, ETL, SQL, Automation, data frameworks, and processes to rapidly integrate disconnected and disparate data sources into automated datasets for analyst's consumption.
Must have a proven track record working with enterprise metrics, strong operational skills to drive efficiency and speed, expertise building repeatable data engineering processes, strong project management skills, and a vision of how to deliver data products.