Sr Data Engineer
Tasks
- Design and evolve data architecture for analytics BI and AI ML
- Design real time and batch data pipelines using Databricks and Spark
- Develop Python and Spark processes for data ingestion transformation and loading
- Improve pipeline speed scalability and reliability
- Monitor pipeline health troubleshoot data issues
- Onboard new data sources into the data warehouse
- Perform code reviews and promote testing and CICD best practices
Perks/Benefits
- N/A
Skills/Tech-stack
Agile | Apache Spark | CI/CD | Cloud Data | Cloud Data Pipelines | Data Pipelines | Data Warehouse | Databricks | Event Hub | Kafka | Power BI | Python | SQL | Streaming | Tableau | Testing
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Related jobs
-
Data Engineer-Secret Clearance Required USD 100K-127KAWS | AWS Glue | AWS Redshift | Azure | Azure Data401k match | Bereavement leave | Disability insurance | Employee assistance program | Employee discount programSenior-level Full TimeRemote - Nationwide, United States R5h ago
-
Applied Research Scientist / Engineer USD 175K-250KData Curation | Deep learning | Diffusion Models | Distributed Training | Domain AdaptationMid-level Full TimeNew York, NY, SF Bay Area, …6h ago
-
AI Engineer (GenAI & Integration) USD 130K-181KAI Agents | AI Governance | API Integration | Automation workflows | DeploymentMid-level Full TimeCenter, Center District, IL7h ago
-
Senior Software Engineer - San Francisco (Onsite) USD 130K-220KAWS | Amazon EMR | Amazon S3 | Apache Flink | Apache SparkFast-paced startup environment | Onsite work environment | Rapid hiring process feedback | Relocation supportSenior-level Full TimeSan Francisco, CA, US8h ago
-
SYSTEM ENGINEER - Computer Network Support - AI/ML - 6+ yrs of Experience - TS/SCI w/Poly clearance is required - ES A USD 136K-140KArtificial Intelligence | Confluence | Jira | LLM | Machine Learning401k retirement plan | Dental insurance | Life insurance | Medical insurance | Paid time offMid-level Full TimeFort George G Meade, United States8h ago
-
Lead Data Engineer – Snowflake USD 170K-216KAmazon S3 | Apache Airflow | Azure Data | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUnited States9h ago
-
Software Engineer 2/3-BY-SIG-02 USD 78K-250KAccumulo | BSON | Bigtable | Docker | HBase401k match | Diverse inclusive workplace | Employee referral programs | Flexible work arrangements | Mental health supportSenior-level Full TimeHanover, MD9h ago
-
IT Data Engineer USD 60K-65KANSI X12 | AWS | Azure | Azure Data | Azure Data Factory401k retirement plan | Disability coverage | Employee assistance program | Flexible spending account | Medical/Dental/Vision insuranceMid-level Full TimeUS - Remote R9h ago
-
Data Engineer III USD 134K-161KAccess Control | Analytics Cloud | Data Governance | Data Marts | Data Quality401k | Adoption Assistance | Dental insurance | Education reimbursement | FSASenior-level Full TimeIrvine, CA10h ago
-
GenAI Engineer III USD 110K-218KArtificial Intelligence | Containerization | Data Analysis | Data Pipelines | DockerProfessional developmentSenior-level Full TimeArlington/Rosslyn, Virginia, United States10h ago
-
Generative AI Engineer III USD 110K-218KArtificial Intelligence | Data Analysis | Data Pipelines | Docker | KubernetesDiscretionary annual incentive program | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …10h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Docker | Generative AI | KubernetesSenior-level Full TimeAustin, Texas, United States; Boston, Massachusetts, …10h ago
-
Lead Generative AI Data Engineer III USD 159K-265KArtificial Intelligence | Data Pipelines | Generative AI | Language Models | Language ProcessingSenior-level Full TimeAtlanta, Georgia, United States; New York, …10h ago
-
Generative AI Data Engineer III USD 131K-218KAlgorithm Development | Artificial Intelligence | Data Analysis | Data Modeling | Data PipelinesMentorship | Travel opportunitiesSenior-level Full TimeAtlanta, Georgia, United States; New York, …10h ago
-
Sr. Data Engineer - Data Engineer III USD 125K-198KAWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon RedshiftSenior-level Full TimePhiladelphia, Pennsylvania, United States10h ago
-
Integration Engineer II - AI and Python Developer USD 86K-170KAI Ops | AWS Bedrock | Azure | CI/CD | Fine TuningAgile team collaboration | Mentorship | Professional developmentMid-level Full TimeAtlanta, Georgia, United States; Baltimore, Maryland, …10h ago
-
Sr. AI Engineer USD 150K-175KAccess Control | Agentic AI | Auditability | CI/CD | Cloud platform401k | Dental insurance | Expense reimbursement for internet costs | Life insurance | Medical insuranceSenior-level Full TimeRemote, USA, United States R10h ago
-
Applied AI & ML Lead - Markets Operations USD 177K-215KData Analysis | Feature Engineering | Generative AI | Language Models | Large Language ModelsBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimeJersey City, NJ, United States17h ago
-
Senior Data Engineer, Strategic Partnerships & IMPACT360 USD 154K-209KAWS Glue | AWS Lake Formation | AWS Lambda | Amazon Athena | Apache AirflowSenior-level Full TimeSeattle, Washington, USA22h ago
-
Edge AI Engineer USD 100K-150KBenchmarking | Bias Evaluation | C++ | Core ML | Data PrivacyCareer growth | Health benefits | Remote workSenior-level Full TimeUnited States - Remote R22h ago
-
AI Research Engineer (Applied AI) USD 100K-150KAgent systems | Computer Vision | Data Quality | Data quality monitoring | Deep learningMid-level Full TimeUnited States - Remote R22h ago
-
LLM Fine-Tuning Engineer USD 100K-150KAdapter methods | Attention Optimization | Benchmarking | Dataset Quality Assurance | Dataset curationCareer growth | Mentorship | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
Quantitative Developer (Fintech) USD 100K-150KAudit trails | Backtesting | C++ | Cloud Native | Cloud-native ArchitecturesBenefits | Career growth | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
Robotics Software Engineer USD 100K-150KBehavior Trees | C++ | Code review | Concurrent Systems | Control SystemsCareer growth | Health benefits | Mentorship | Remote workMid-level Full TimeUnited States - Remote R22h ago
-
AI Engineer, Global Operations USD 107K-143KArtificial Intelligence | ETL | Langchain | Machine Learning | PythonContinuous learning | Flexible work options | Health, wellness, and retirement plans | Professional growth opportunitiesMid-level Full TimeCalifornia - Remote, United States R22h ago