Our company is seeking a skilled Data Engineer who will be responsible for designing, building, and maintaining data pipelines that collect and process large-scale tourism-related data from online and social platforms.
In this role, you will lead the development of data scraping and crawling solutions, ensuring the reliable acquisition, transformation, and storage of unstructured and semi-structured data to support analytics and insight generation. You will work closely with data analyst and research teams to deliver scalable data infrastructure, improve data quality, and enable data-driven decision-making across the organization.
JOB DUTIES & RESPONSIBILITIES
● Build and maintain scalable data acquisition pipelines (crawler + API collectors) for multiple online sources.
● Develop ETL/ELT workflows to ingest, clean, transform, and structure large volumes of unstructured data.
● Optimize data processing performance on cloud data warehouses (e.g., BigQuery or similar).
● Ensure pipeline reliability through logging, monitoring, alerting, and automated validation checks.
● Collaborate with data/research teams to define data models, analytical datasets, and integration requirements.
● Contribute to continuous improvement of data engineering standards, scalability, and code quality.
JOB REQUIREMENT & QUALIFICATIONS
Must have
● Strong proficiency in Python for data pipelines (requests, or crawling frameworks such as Scrapy / Playwright).
● Solid knowledge of SQL and experience with cloud data warehouses (BigQuery, Snowflake).
● Hands-on experience building data ingestion pipelines (crawler, API integration, batch/stream ETL).
● Understanding of pipeline reliability: logging, error handling, retry strategies, monitoring.
● Ability to write clean, maintainable, production-ready code.
Nice to have
● Experience with multi-language NLP, embeddings, or classification models.
● Experience handling noisy, large-scale unstructured data (social, web content, reviews…).
HOW TO APPLY
Please submit your resume and cover letter to hr@the-outbox.com
Scroll down to learn more about this role. If you have any questions, email us at hr@the-outbox.com.
