Job Information
Insight Global REMOTE Data Engineer in Minneapolis, Minnesota
Job Description
We are seeking a REMOTE Data Engineer to join the Pharmacy team at a large provider/payor.
Responsibilities
Design, develop, and implement end-to-end data solutions using Azure Databricks and other relevant technologies.
Build and maintain scalable data pipelines to extract, transform, and load large volumes of data from various sources.
Collaborate with cross-functional teams to analyze data requirements and translate them into technical specifications.
Ensure data quality and integrity by implementing data validation and cleansing processes.
Optimize data processing and storage for improved performance and efficiency.
Conduct data profiling, analysis, and modeling to identify opportunities for data-driven insights and recommendations.
Monitor and troubleshoot data pipelines and processes to ensure continuous data flow and availability.
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .
To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .
Skills and Requirements
3+ years of most-recent experience as a Data Engineer in an Azure, not AWS, environment, building code, and QA'ing it.
Proficient in programming languages such as Python, PySpark, Scala, and SQL.
Strong experience with Azure Databricks and other Azure services, such as Azure Data Factory and Azure SQL Database.
Healthcare data experience (at a payor/provider, familiar with HIPPA regulations)
Experience with data integration, transformation and orchestration frameworks such as Airflow, dbt, Fivetran or similar
Solid understanding of data engineering principles, including data modeling, data integration, and data architecture.
Use of tools such as Git, GitHub Actions, Agile, Jira and Confluence or similar.
Clear interpersonal communication to work closely with the business, and to ask the right questions/translate business needs into optimized and efficient data models in SQL or NoSQL.
Experience in a large organization, and ability to work that kind of fast-paced, deadline-driven environment. Medallion Architecture experience
Experience with Agile methodologies
Relevant certifications in Azure Databricks or related technologies
Pharmacy data experience null
We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.