Senior Data Engineer – 8+ Years Experience
A USD 70K-80K Mid-level Contract Full Time
Tasks
- Apply data security and governance
- Build ETL/ELT workflows
- Build incremental processing and CDC
- Conduct code reviews
- Create unit integration and data quality tests
- Design batch and real-time data pipelines
- Design data warehouses and lakehouses
- Develop distributed data processing jobs
- Document data architecture and models
- Establish data quality monitoring
- Implement cloud data platforms
- Implement streaming data pipelines
- Mentor data engineers
- Orchestrate data workflows
- Perform performance tuning
- Set up CI/CD for data workflows
- Troubleshoot production data issues
- Write optimized SQL queries
Perks/Benefits
- N/A
Skills/Tech-stack
AWS EMR | AWS Glue | AWS IAM | AWS Lambda | Access Control | Agile | Amazon Athena | Amazon Kinesis | Amazon Redshift | Amazon S3 | Apache Airflow | Apache Kafka | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Databricks | Azure Event | Azure Event Hubs | Azure Functions | Azure Key Vault | Azure Synapse | BigQuery | Bitbucket | CCPA | CDC | CI/CD | Cassandra | Cloud Composer | Cloud Storage | Clustering | DBT | Data Factory | Data Lake | Data Lake Storage | Data Modeling | Data Quality | Data Validation | Data Warehousing | Databricks | Dimensional Modeling | Docker | DynamoDB | ELT | ETL | Encryption | Event Hubs | GDPR | Git | GitHub | GitLab | Google BigQuery | Google Cloud | Google Cloud Storage | Google Dataflow | Google Dataproc | Google Pub/Sub | HIPAA | Incremental processing | Informatica | Infrastructure as Code | Key Vault | Kubernetes | Lakehouse | MongoDB | Monitoring | MySQL | Observability | Oracle | Partitioning | Partitioning and Performance Optimization | Performance optimization | PostgreSQL | Pub/Sub | PySpark | Python | Role-Based Access | Role-Based Access Control | SQL | SQL Server | Scrum | Slowly Changing Dimensions | Snowflake | Snowflake Schema | Star Schema | Talend | Terraform | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
API Development | Azure | Azure Data | Azure Data Factory | Azure Data LakeRemote workSenior-level Full TimeWork from home, VA, United States10h ago
-
ClaimsXM Data Engineer III USD 125K-140KAnalysis Services | Azure | Azure Data | Azure Data Factory | Data Cleansing401k employer match | Health insurance | Paid Holidays | Paid Long Term Disability | Paid Short Term DisabilitySenior-level Full TimeUnited States10h ago
-
Senior-level Full TimeUnited States16h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAI APIs | AWS | Apache Spark | Application development | Artificial IntelligenceCustomer travel 20 percent timeSenior-level Full TimeSan Francisco, California16h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Application development | Artificial Intelligence | AzureCustomer-facing role | Travel 20 percent timeSenior-level Full TimeRemote - Washington D.C. R16h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Azure | CI/CD | DatabricksTravel 20 percentSenior-level Full TimeNew York City, New York16h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAPI Integration | AWS | Apache Spark | Artificial Intelligence | AzureTravel 20 percent timeSenior-level Full TimeChicago, Illinois16h ago
-
Sr. Forward Deployed Engineer USD 182K-250KAWS | Apache Spark | Artificial Intelligence | Azure | CI/CDCustomer-facing role | Travel 20 percent of the timeSenior-level Full TimeAustin, Texas; USCA16h ago
-
Senior Spacecraft Embedded Linux Engineer, C++ USD 169K-216KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k match | Dental insurance | EV charging | FSA | Flexible PTOSenior-level Full TimeEl Segundo, California, United States18h ago
-
Spacecraft Embedded Linux Engineer, C++ USD 131K-184KAnalog electronics | Bare Metal | C++ | CAN | CCSDS401k employer match | EV charging | Flexible PTO | Gym Wellness Reimbursement | HSA employer matchEntry-level Full TimeEl Segundo, California, United States18h ago
-
Senior Data Scientist - Ontology USD 128K-170KCypher | Data integration | Data profiling | Description logics | Entity ResolutionSenior-level Full TimeOffice Location or Remote - USA R18h ago
-
Machine Learning Engineer I, Network USD 151K-189KClassification | Data Pipelines | Deep learning | Embedding Models | Experiment tracking401k match | Commuting support | Fertility benefits | Flexible PTO | Free lunchSenior-level Full TimeSan Francisco, CA18h ago
-
Applied LLM Systems Engineer USD 191K-253KAccess Management | Agent systems | Auditability | Caching | Cloud infrastructureSenior-level Full TimeCosta Mesa, California, United States18h ago
-
Senior Data Science Engineer USD 160K-175KAPI Development | Apache Airflow | Apache Spark | CI/CD | DBTFlexible work optionsSenior-level Full TimeRemote (United States) R19h ago
-
Accounting Analytics & BI Engineer USD 220K-270KAirflow | Analytics engineering | Business Intelligence | DBT | Data ModelingFlexible working hours | Generous vacation | Health benefits | Hybrid work policy | Optional equity donation matchingMid-level Full TimeSan Francisco, CA R19h ago
-
Senior Data Engineer USD 100K-120KAWS | Agile | Azure | Cloud Architecture | Data Lake401k employer match | Career development | Dental insurance | Employee discounts | Employer Disability BenefitsSenior-level Full TimeBurnsville, MN, US19h ago
-
Senior Quantum Applications Engineer USD 125K-187KArtificial Intelligence | CI/CD | CUDA Quantum | Code review | CryptographySenior-level Full TimeNew Haven, CT20h ago
-
Staff Machine Learning Engineer USD 176K-308KAPI Design | Distributed Systems | Generative AI | Hybrid search | Inference Optimization401k plan with company match | ESPP | Family Leave Program | Flexible spending accounts | Flexible time awaySenior-level Full TimeSanta Clara, California, United States R20h ago
-
Senior Robotics Software Engineer USD 145K-175KARM | C++ | Cloud processing | Computer Vision | Deep learning401k match | Flexible time off | Gym memberships | Medical/Dental/Vision insurance | Wellness programsSenior-level Full TimePittsburgh, PA20h ago
-
Senior Analytics Engineer, Marketing Sciences USD 100K-125KAmazon Kinesis | DBT | Docker | JSON | Kafka401k match | Dental insurance | Employee resource groups | Flexible time off | Life and disability insuranceSenior-level Full TimeUnited States R20h ago
-
Senior Analytics Engineer USD 111K-160KAirflow | Business Intelligence | Data Governance | Data Modeling | Data Quality401k matching | Dental insurance | Fitness Center | Health insurance | Paid time offSenior-level Full TimeLehi, Utah20h ago
-
Senior Software Engineer - Storage USD 243K-295KActive architecture | Active-active Architecture | Active/Active | Alertmanager | As-a-ServiceSenior-level Full TimeSan Mateo, CA, United States R20h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI Integration | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeRichmond21h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-200KAPI | AWS | Apache Airflow | Apache Spark | AzureSenior-level Full TimeDallas21h ago
-
Principal Consultant, Palantir Data & AI Engineer USD 135K-196KAPIs | AWS | AWS Glue | Amazon Redshift | Apache AirflowSenior-level Full TimeMinneapolis21h ago