Who are we? 
At Data Ideology (DI), we provide Data & Analytics expertise to drive measurable business outcomes, often solving complex business problems for our clients. Our data analytics advisory services enable our customers to transform data into insights by driving a culture of empowerment and ownership of results. Our team consists of highly motivated individuals passionate about learning, understanding, collaborating, and intellectually curious.  For more information about Data Ideology, visit www.dataideology.com.

What are we seeking?
We are seeking a highly skilled and experienced Senior Data Architect specializing in Databricks technology to lead our efforts in configuring and deploying advanced data processing solutions. This role demands a candidate with a strong background in Databricks configuration projects. Healthcare experience is preferred but not required.

For this role, we're pleased to discuss your preference for full-time, contract, or independent consultancy engagements. Let us know what works best for you!" line in there.

Responsibilities 

• Databricks Configuration Expertise: Lead the configuration of the Databricks environment, ensuring optimal setup of clusters, libraries, and notebooks. Proven examples of configuring secure, scalable, and efficient data processing pipelines are essential.
• Initial Assessment & Planning: Align Databricks with business objectives, and identify and evaluate use cases, data sources, and integration points.  
• Technical Evaluation: Assess data volumes, performance requirements, and the existing technology stack to integrate Databricks effectively. Any experience with healthcare regulations (e.g., GDPR, HIPAA) and security needs is preferred but not required.   
• Collaboration & User Management: Define user roles and permissions, and integrate Databricks into the software development lifecycle with an emphasis on collaborative features.
• Deployment & Configuration: Set up and configure the Databricks workspace, including clusters, libraries, and notebooks. Establish user roles, permissions, and development workflows within Databricks. Experience in setting up environments that foster innovation while ensuring data governance and compliance is crucial. Develop connections to existing data sources, ensuring compliance and providing end-user guidance.
• Monitoring, Logging, & Compliance: Implement monitoring and logging to oversee system performance and usage.  
• Stakeholder Engagement: Work closely with project sponsors, stakeholders, and practitioners to gather requirements and secure configuration sign-off. Create and execute deployment plans.

Qualifications

• Bachelor's or Master's degree in Computer Science, Data Science, Information Technology, or related field.
• Minimum of 5 years of experience as a Data Architect with extensive focus on Databricks and configuration experience.   
• Advanced knowledge in SQL, Python, Scala, or similar, with proven ability to implement efficient data processing and analytics solutions in Databricks.
• Strong project management skills, with examples of managing Databricks configuration projects from conception to deployment.

Additional Skills

• Strong communication and interpersonal skills to interact with both technical and non-technical stakeholders.
• Ability to lead projects, meet deadlines, and manage changes effectively.
• A commitment to continuous learning in data architecture best practices.

Why Join Us?
Join a forward-thinking organization dedicated to driving data-driven innovations. We offer a competitive package, professional development opportunities, and a culture that values creativity and efficiency.

Application Process
Qualified candidates are invited to submit a resume and a cover letter detailing their experience with Databricks technology and specific accomplishments.

Work Environment: 

• Remote work from home.
• Hours of work and days are generally Monday through Friday. Specific business hours will depend on client needs. 

Physical Demands: 

• Must be able to remain in a stationary position 50% of the time.
• The person in this position must occasionally move about inside the office to access file cabinets, library stacks, office machinery, etc.
• Constantly operates a computer and other office productivity machinery, such as a calculator, copy machine, and printer.
• The person in this position frequently communicates with clients and coworkers.
• Must be able to exchange accurate information in these situations. 

Data Ideology is an EEO Employer.