Data Engineer II
Tasks
- Build and optimize data ingestion transformation and integration processes
- Create and maintain technical documentation and data mappings
- Create and optimize SQL queries and database objects
- Design and maintain scalable ETL/ELT data pipelines
- Develop and support SSIS packages and data integration workflows
- Develop and support data warehouses data marts and analytical data models
- Monitor data quality and resolve performance bottlenecks
- Process and transform large datasets with Databricks Apache Spark and Delta Lake
- Support HIPAA compliance data governance and data security
Perks/Benefits
Skills/Tech-stack
Apache Spark | CI/CD | CPT | Data Governance | Data Mart | Data Security | Data Warehouse | Databricks | Delta Lake | ELT | ETL | FHIR | Git | HIPAA | HL7 | ICD-10 | Microsoft SQL | Microsoft SQL Server | PL/SQL | Performance Tuning | PySpark | Python | Query Optimization | SQL | SQL Server | SSIS | Stored Procedures
Education
Bachelor of Engineering | Bachelor of Engineering in Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Information Technology
Roles
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R29d ago
-
Data Engineer III/Senior (Analytics) USD 130K-170KAnalytics engineering | Azure | CCPA | CI/CD | DORA Metrics401k retirement plan | Dental insurance | Employee stock purchase plan | Health insurance | Life insuranceSenior-level Full TimeIrving, TX, United States R9h ago
-
AI Search | AI Security | AWS | AWS Bedrock | Agent memoryHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States R10h ago
-
Embedded Software Engineer - Energy Systems USD 73K-94KBare Metal | Battery Management | Battery Management Systems | C plus plus | C#13 paid holidays | 401k match | Dental insurance | Employee assistance program | Life insuranceEntry-level Full TimeGreene, NY, United States10h ago
-
Senior Data Engineer USD 109K-163KAI | API | Analytics Platforms | Analytics solutions | Apache Spark401k | Adoption Assistance | Defined contribution | Discount programs | Employee assistance programsSenior-level Full TimeJohnston, IA,Iowa,United States11h ago
-
Sr. Databricks Consultant - Top Secret Clearance USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDTop Secret clearanceSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Sr. Databricks Consultant - TS/SCI-FSP USD 175K-250KAWS | AWS S3 | Apache Spark | Azure | Azure DataAdditional funding contingent | Benefits package | Travel as neededSenior-level Full TimeFAIRFAX, VA, United States11h ago
-
Mid-level Full TimeKing George, VA, United States11h ago
-
Sr. Databricks Consultant - DHS Public Trust USD 175K-250KAWS S3 | Apache Spark | Azure Data | Azure Data Lake | CI/CDSenior-level Full TimeWork from home, VA, United States11h ago
-
Hiring for Senior AI Software Engineer (Agentic AI / AI Agents) | Hybrid | W2 Role | F2F Interview in NJ USD 115K-150KAI Agents | AWS | Agentic AI | Audit Logging | AzureHybrid work | In-person interviewSenior-level Contract Full TimeJersey City, NJ, United States12h ago
-
Data Architect (Hybrid - St. Paul, MN) USD 130K-174KAccess Control | Azure | Azure Backup | Azure CLI | Azure DataHybrid work | W2 employmentSenior-level Full TimeSt Paul, Minnesota R12h ago
-
Ab Initio | Agile | Data Integrity | Data Management | Data ModelingHybrid work | Local candidates onlyMid-level Full TimeDallas, Texas12h ago
-
Principal Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contract to Hire - AS A USD 132K-165KAmazon Kinesis | Amazon RDS | Amazon Redshift | Amazon Web Services | Apache HBaseSenior-level Full TimeIrvine, CA12h ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R12h ago
-
Calibration | Data Generation | Deep learning | Distillation | EHREquity | Health benefits | High autonomySenior-level Full TimeNew York, NY, United States R13h ago
-
ABAC | AWS | Access Management | Apache Iceberg | CI/CDSenior-level Full TimeBoston, MA, United States14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeBaltimore, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Apache Airflow | Apache Spark | AvroEducation budget | Exciting projects | Fitness budget | Flexible schedule | MentorshipSenior-level Full TimeHouston, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Kafka | AvroFlexible schedule | Mentorship | Personalized growth roadmaps | Professional growth | Remote and office optionsSenior-level Full TimeWest Palm Beach, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Apache Airflow | Apache Spark | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeBoca Raton, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Apache Kafka | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJersey City, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | AWS Glue | Apache Airflow | Apache SparkEducation budget | Fitness budget | Flextime | Mentorship | Personalized growth roadmapsSenior-level Full TimeTallahassee, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPI Integration | AWS | Airflow | Apache Spark | AvroFlexible schedule | Mentorship | Office options | Personalized growth roadmaps | Remote work optionsSenior-level Full TimeJacksonville, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAWS | Airflow | Amazon SageMaker | Amazon SageMaker Studio | Apache SparkEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapsSenior-level Full TimeLos Angeles, United States R14h ago
-
Senior Data Engineer ID75059 USD 155K-170KAPIs | AWS | Airflow | Avro | DuckDBEducation budget | Fitness budget | Flexible schedule | Mentorship | Personalized growth roadmapSenior-level Full TimeFort Lauderdale, United States R14h ago