Lead Software Engineer - Big Data
USD 114K-248K Senior-level Full Time
Tasks
- Analyze software development trends and engineering best practices
- Apply secure coding and application security best practices
- Coach and train engineers on techniques and processes
- Design and develop scalable distributed data processing solutions
- Develop performance tuning strategies for large scale data processing
- Diagnose and resolve production data job failures
- Implement CI and CD pipelines
- Improve product quality across software development lifecycle
- Manage and maintain software development environments for build validation
- Own development of software products
- Share progress and technical updates with stakeholders
Perks/Benefits
- 401k match
- Commuter benefits
- Health, dental, and vision insurance
- Hybrid work environment
- Life and disability insurance
- Paid time off
- Personal days
- Sick days
- Tuition reimbursement
- Wellness programs
Skills/Tech-stack
AWS EMR | AWS Glue | AWS Lambda | AWS S3 | Amazon Athena | Amazon EKS | Apache Spark | Application Security | CI/CD | Data Modeling | Design Patterns | DevOps | GitHub Copilot | Hadoop | Hive | Infrastructure as Code | Kanban | NoSQL | Object-Oriented | Object-oriented programming | Performance Tuning | Prompt engineering | Python | Relational databases | SQL | Scala | Scrum | Secure Coding | Serverless | System design | Test automation | Trino | Unit Testing | “as-code”
Education
Roles
Engineer | Lead | Lead Software Engineer | Software Engineer
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
AI Engineer II - Active TS/SCI w/poly clearance USD 113K-190KC# | Data Engineering | Data Governance | Data Modeling | Data StructuresDental insurance | Disability insurance | Educational assistance | Employee assistance program | Health insuranceMid-level Full TimeAnnapolis Junction, Maryland1h ago
-
Software Engineer 3 – AI/ML USD 113K-279KAWS | Artificial Intelligence | Azure | Docker | ElasticsearchAgile environment collaboration | Partial teleworkSenior-level Full TimeAnnapolis Junction, MD1h ago
-
Senior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …1h ago
-
Software Engineer USD 113K-279KApache Pig | Apache Spark | Continuous Monitoring | Data Ingestion | Data QualitySenior-level Full TimeLinthicum, MD; Annapolis Junction, MD; Annapolis …1h ago
-
Database Engineer II USD 124K-208KAWS | Agile | Confluence | Django | Docker401k match | Dental insurance | Health insurance | Immediate 401k vesting | Paid time offSenior-level Full TimeLinthicum, MD1h ago
-
Database Engineer III USD 124K-208KCloud Computing | Continuous Monitoring | Data Modeling | Data Storage | Database ArchitectureActive TS SCI clearance with polygraph | Benefits packageSenior-level Full TimeLinthicum, MD; Linthicum Heights, MD1h ago
-
Mid-level Full TimeSuitland, MD; Annapolis Junction, Maryland; Crystal …2h ago
-
Systems Engineer - Modeling and Algorithms USD 112K-160KC# | C++ | Data Analysis | Digital System | Digital system modelingSenior-level Full TimeHuntsville, Alabama; Annapolis Junction, Maryland2h ago
-
Apache Tika | Data Visualization | Language Processing | Machine Learning | MbseMid-level Full TimeAnnapolis Junction, Maryland2h ago
-
Anomaly Detection | Data Engineering | Data Lakes | Data Pipelines | Data ProcessingRegular team sessions | Remote friendly schedule | Team collaborationSenior-level Full TimeRemote, Canada (EST); San Francisco, California R2h ago
-
Data Analysis | Data pipeline | Machine Learning | Multimodal Learning | PythonMid-level Full TimeSan Francisco, California; Toronto, Canada; Redwood … R2h ago
-
Active Learning | Adaptive Sampling | Deep learning | Direct Preference Optimization | Human FeedbackMid-level Full TimeSan Francisco, California; Remote, US or … R2h ago
-
Agile | Cloud Storage | Google Cloud | Google Cloud Storage | GraphQLMid-level Full TimeSan Francisco, California; Remote, Canada, US, … R2h ago
-
Artificial Intelligence | Cloud Computing | Data integration | Generative AI | High AvailabilityMid-level Full TimeNew York City, NY; Toronto, Ontario; … R2h ago
-
AWS | AWS Bedrock | AWS CDK | Anthropic | CelerySenior-level Full TimeKitchener, Ontario; Remote, Canada; Remote, Canada; … R2h ago
-
AWS | Azure | Data Analysis | Data Visualization | Deep learningMid-level Full TimeRemote, Canada; San Francisco, California; Toronto, … R2h ago
-
Data Warehousing | Deep learning | Experimentation | Infrastructure | LLMSenior-level Full TimeRemote, Canada or US; Remote, Canada … R2h ago
-
AI Agents | Generative AI | Java | Language Models | Large Language Models401k plan | Free meals | Health insurance | Parental leave | Unlimited PTOEntry-level Full TimeSan Francisco, California2h ago
-
Senior-level Full TimeCanada or US, N/A; Toronto, Ontario; … R2h ago
-
AWS | Azure | Data Annotation | Data Pipelines | Docker100% remote in Quebec | AI coding tool subscription | Bilingual support | Travel up to 25 percentMid-level Full TimeMontreal or Quebec City, Quebec; Toronto, … R2h ago
-
AWS CDK | AWS DynamoDB | AWS EventBridge | AWS Glue | AWS KinesisSenior-level Full TimeToronto, Ontario; Toronto, Ontario; Toronto, Ontario; …2h ago
-
API Design | Alerting | Browser Automation | Data Modeling | Database SchemaEquity package | Professional growth opportunities | Unlimited growthSenior-level Full TimeBay Area, California2h ago
-
Anomaly Detection | Classification | Clustering | Data Modeling | Data PipelinesHealth benefits | Hybrid work arrangement | Paid time off | Professional developmentSenior-level Full TimeToronto, Ontario; Kitchener, Ontario; The Valley, … R2h ago
-
AWS Data | AWS Data Lakes | Amazon Web Services | Apache Spark | Data AnalysisFlexible work schedule | Hybrid work modelSenior-level Full TimeToronto, Ontario; Remote, Canada; Toronto, Ontario; … R2h ago