LEAD Consultant - Databricks Engineer Job at YuVi Systems Inc, Dallas, TX

eFROS3VZRFRvd0VpcjJjZTNxMGU1c2lvZFE9PQ==
  • YuVi Systems Inc
  • Dallas, TX

Job Description

Location: Remote |  Domain: Healthcare (Payers)

Company: Yuvi Systems

Overview:

Yuvi Systems is seeking a  Senior Databricks Engineer with deep expertise in Databricks tools and frameworks, particularly within the  Healthcare Payer domain . This role involves designing and implementing scalable, high-performance data pipelines to support analytics, reporting, and regulatory compliance.

Key Responsibilities:
  • Design and build scalable data pipelines using  Databricks (notebooks, workflows, clusters) .
  • Process and transform healthcare data in  HL7, CCDA, FHIR , XML, JSON, and delimited formats.
  • Implement  Delta Lake for ACID-compliant data operations and performance optimization.
  • Manage secure cloud storage (Azure Blob, S3, or Databricks Volumes) for data ingestion and access.
  • Develop ETL/ELT pipelines using  Delta Live Tables (DLT)and automate workflows.
  • Code in  PySpark, Scala, SQL , and optimize transformations in distributed environments.
  • Integrate Databricks with Power BI and develop reports/dashboards.
  • Leverage  Unity Catalog for data lineage, access control, and governance.
  • Embed  DevOps and CI/CD practices (GitLab, DABs) into data workflows.
  • Mentor junior engineers and support cross-functional collaboration.
  • Deliver high-quality, timely solutions aligned with client needs and data quality standards.
Required Experience & Skills:
  • 5+ years in Data Engineering; 3+ years with  Databricks .
  • Experience in the  Healthcare Payer domain (claims, eligibility, HIPAA/CMS compliance).
  • Strong with  Delta Lake PySpark , and  Apache Spark .
  • Hands-on with  ETL/ELT in Azure or AWS .
  • Proficient in  Power BI (DAX, dataset tuning, report development).
  • Solid understanding of  Medallion Architecture and  Lakehouse principles.
  • Experience with structured/semi-structured data, APIs, and cloud storage.
  • Skilled in Git, CI/CD, and DevOps practices.
  • Excellent communication and consulting skills.
  • Bachelor's in Computer Science, Information Systems, or related field.

Job Tags

Remote job,

Similar Jobs

KRGV-TV

News Reporter Job at KRGV-TV

 ...KRGV TV Channel 5 News (ABC) in the McAllen-Weslaco-Brownsville market (#80) is looking for a dynamic News Reporter to join the largest news operation in South Texas. The successful candidate will be someone who has the ability to develop contacts and online sources... 

Koenig Financial Group

KFG Financial Advisor Job at Koenig Financial Group

 ...individual goals. If you are passionate about helping people have a secure financial future and want to build equity in the firm, please...  ...Engagement: Participate in existing community and industry events in which KFG is or becomes active. We are a creative, collaborative... 

Tucker Parker Smith Group (TPS Group)

Regulatory Affairs Specialist Job at Tucker Parker Smith Group (TPS Group)

 ...Regulatory Affairs Specialist (IVDR) Location: Irvine, CA. (HYBRID T/TH 3rd day of choice )12 Month Assignment (Potential to Extend) Pay rate $45$50/hr. DOE On behalf of our client a medical device company we are seeking for a Regulatory Affairs Specialist... 

Conrad Consulting

Structural Engineer Job at Conrad Consulting

 ...A leading engineering firm in New York City is looking for a motivated Structural Engineer to join their team and contribute to the design of construction engineering projects supporting major infrastructure developments. This role offers the opportunity to work closely... 

Tyler Oral & Facial Surgery

RCM Account Receivables Specialist Job at Tyler Oral & Facial Surgery

 ...The Accounts Receivables Specialist is responsible for managing dental and medical outstanding insurance balances, following up on...  ...Vision Insurance (Virtual Care included) Confidential Employee Assistance Program (EAP) for you and your family Financial Wellness...