Senior Software Engineer (Python)
Tasks
- Automate workflows with Apache Airflow
- Build data ingestion pipelines
- Build distributed crawling bots
- Build search capabilities with ElasticSearch OpenSearch
- Clean and normalize raw data
- Deploy solutions in Kubernetes on AWS
- Develop APIs for structured classified data
- Extract data from web pages APIs and PDFs
- Integrate classification models into the pipeline
- Optimize and scale processing with Spark
- Preprocess data for classification and search indexing
- Unify documents into a coherent schema
Perks/Benefits
- 401k match
- Accidental death and dismemberment insurance
- Continuing education support
- Dental insurance
- Fitness reimbursement
- Flexible spending accounts
- Health insurance
- Health savings accounts
- Home office setup bonus
- Hybrid work
- Life insurance
- Medical leave
- Mental health counseling
- Paid Maternity Leave
- Paid time off
- Parental bonding leave
- Prescription Coverage
- Remote work
- Vision insurance
- Wellness benefits
Skills/Tech-stack
AWS | Anti-scraping | Apache Airflow | Data Normalization | Data cleaning | Distributed crawling | Document Classification | EMR | Elasticsearch | Hugging Face | Kubernetes | LLMs | Language Processing | Machine Learning | NLP models | Natural Language | Natural Language Processing | NoSQL | OCR | OpenSearch | PDF Processing | PyMuPDF | PyTorch | Python | REST APIs | SQL | Scrapy | Search Indexing | Spacy | Spark | TensorFlow | Tesseract
Education
N/A
Related jobs
-
Mid-level Full Time广州 R6h ago
-
AI Expert USD 148K-175KAWS | Agile | Batch Processing | Data Mapping | Data ModelingHybrid work | Public Trust Clearance | Remote workSenior-level Full TimeMemphis, TN, United States R8h ago
-
Senior Data Engineer | Databricks (26DE02ES) USD 180K-247KAWS | Agile | Apache Spark | CI/CD | Data GovernanceFlexible work arrangements | Remote work | Time-off policy | Training and development programsSenior-level Full TimeRemote R8h ago
-
Ingénieur traitement de données et algorithmie EUR 40K-45KAlgorithm Design | Code packaging | Documentation | Geospatial Data | Machine LearningFamily health insuranceMid-level Full TimeCesson-Sévigné, Ille-et-Vilaine, Bretagne, FR R10h ago
-
AI Engineer EUR 28K-35KAWS | Azure | Deep learning | Docker | GCP100 percent remote | Autonomy | Career growth | Continuous learning | No micromanagementEntry-level Full TimeRemoto España, España R11h ago
-
AI Agents | AWS | Anthropic | CI/CD | Distributed SystemsSenior-level ContractRemote R11h ago
-
Lead- Data Analysis INR 2800K-4000KAlteryx | Automation | Correlation Analysis | Dashboards | Data ModelingEmployee discounts | Financial coaching | Health insurance | Hybrid work | Mental health supportSenior-level Full TimeBengaluru, Karnataka, India, India R12h ago
-
Data Engineer (H/F) EUR 40K-48KAmazon Web Services | Apache Spark | Git | NoSQL Databases | PythonCareer development | Flexible telework | Meal tickets | Paid time off | Training budgetMid-level Full TimeSaint-Ouen, France R12h ago
-
ML / Data Analyst BGN 44K-52KData Pipelines | Data Quality | Machine Learning | Regex | SQLAdditional paid leave | Employee assistance program | Flexible working hours | Food vouchers | Hybrid work modelMid-level Full TimeSofia, 23, Bulgaria R13h ago
-
Analytics Solutions - Associate INR 2040K-3380KAlteryx | Data Compliance | Data Governance | Data Modeling | Data QualityIn office days policy | Remote work optionSenior-level Full TimeBengaluru, Karnataka, India R14h ago
-
Senior AI Engineer CHF 126K-188KAWS Bedrock | AWS Bedrock AgentCore | Agent coordination | Async IO | Bedrock AgentCoreCharity donation matching | Complimentary office amenities | Flexible working hours | Health and fitness subsidy | Hybrid work modelSenior-level Full TimeZurich, Canton of Zurich, Switzerland R15h ago
-
Staff Data Platform Engineer (Remote) EUR 64K-80KAirflow | Amazon Web Services | Apache Flink | Apache Iceberg | Apache SparkAI tool access | Remote work allowanceSenior-level Full TimeLisbon, Portugal R15h ago
-
Data Engineer EUR 42K-48KApache NiFi | Data Modeling | Data Quality | Database Management | ETLFlexible work hours | Free train travel | On-call rotation | Telework | Training and career developmentMid-level Full TimeAnderlecht, BRU, BE, 1070 R17h ago
-
Data Engineer USD 100K-141KAWS EMR | Alerting | Amazon S3 | Amazon Web Services | Apache PrestoAnnual performance bonus plan | Career development planning | Flexible working | Work from anywhere for up to 4 weeks per year | Work from homeMid-level Full TimeKuala Lumpur, Wilayah Persekutuan Kuala Lumpur, … R18h ago
-
Principal Machine Learning Engineer USD 205K-230KAWS Lambda | BigQuery | C# | CI/CD | Cloud Functions401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysSenior-level Full TimeUnited States of America - Remote … R19h ago
-
AWS EC2 | AWS S3 | Airflow | DBT | DagsterContinuous learning | Contract based full time engagement | Fully remote | International team collaborationMid-level Contract Full TimeBrazil R19h ago
-
Lead AI Engineer AUD 167K-200KAgentic Frameworks | CI/CD | Cloud Platforms | Containers | Fine TuningSenior-level Full TimeSydney, Australia R21h ago
-
Staff Data Engineer AUD 120K-130KAWS | BigQuery | DBT | Data Contracts | Data GovernanceCareer growth opportunities | Healthcare impact | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R22h ago
-
Senior Data Engineer AUD 120K-130KA/B | A/B Testing | AWS | B testing | BigQueryProfessional growth | Supportive work environment | Work from anywhereSenior-level Full TimeAustralia R23h ago
-
AI Agents | AWS | AWS Bedrock | Agile | KubernetesNo visa sponsorship | Remote work | Travel up to 50 percentSenior-level Full TimeUS, Remote R23h ago
-
Data Platform Developer SEK 420K-500KAWS | B2B Integration | Bash | BigQuery | Data MigrationHealth subsidy | Hybrid work | Laptop provided | Paid vacation | Pension and insuranceEntry-level Full TimeStockholm, Stockholm County, Sweden R1d ago
-
AI Solution Implementation Engineer INR 800K-1800KAI Agents | API Integration | Business API | CRM Integration | Chatbot DevelopmentMid-level Full TimeIndia - Remote R1d ago
-
AI/Data Solutioning Engineer INR 2000K-4600K.NET | AI Foundry | Agent Orchestration | Apache Spark | Application InsightsSenior-level Full TimeHyderabad, Telangana, India - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLangchain | MLOps | Machine Learning | NumPy | PandasFlexible part-time hours | Project-based assignments | Remote workMid-level FreelanceTexas, United States - Remote R1d ago
-
Freelance Machine Learning Engineer USD 180KLangchain | Language Models | Large Language Models | MLOps | NumPyFlexible weekly hours | Part-time availability | Project based workMid-level FreelanceNew York, United States - Remote R1d ago