Job Description

Location: Remote |  Domain: Healthcare (Payers)

Company: Yuvi Systems

Overview:

Yuvi Systems is seeking a  Senior Databricks Engineer with deep expertise in Databricks tools and frameworks, particularly within the  Healthcare Payer domain . This role involves designing and implementing scalable, high-performance data pipelines to support analytics, reporting, and regulatory compliance.

• Design and build scalable data pipelines using  Databricks (notebooks, workflows, clusters) .
• Process and transform healthcare data in  HL7, CCDA, FHIR , XML, JSON, and delimited formats.
• Implement  Delta Lake for ACID-compliant data operations and performance optimization.
• Manage secure cloud storage (Azure Blob, S3, or Databricks Volumes) for data ingestion and access.
• Develop ETL/ELT pipelines using  Delta Live Tables (DLT)and automate workflows.
• Code in  PySpark, Scala, SQL , and optimize transformations in distributed environments.
• Integrate Databricks with Power BI and develop reports/dashboards.
• Leverage  Unity Catalog for data lineage, access control, and governance.
• Embed  DevOps and CI/CD practices (GitLab, DABs) into data workflows.
• Mentor junior engineers and support cross-functional collaboration.
• Deliver high-quality, timely solutions aligned with client needs and data quality standards.

• 5+ years in Data Engineering; 3+ years with  Databricks .
• Experience in the  Healthcare Payer domain (claims, eligibility, HIPAA/CMS compliance).
• Strong with  Delta Lake ,  PySpark , and  Apache Spark .
• Hands-on with  ETL/ELT in Azure or AWS .
• Proficient in  Power BI (DAX, dataset tuning, report development).
• Solid understanding of  Medallion Architecture and  Lakehouse principles.
• Experience with structured/semi-structured data, APIs, and cloud storage.
• Skilled in Git, CI/CD, and DevOps practices.
• Excellent communication and consulting skills.
• Bachelor's in Computer Science, Information Systems, or related field.

Job Tags

Similar Jobs