Data Engineer (social media data)BuddyReview

Job Summary
We are looking for a Social Data Engineer who is interested in social media data, especially in influencer marketing, or has experience working with social media datasets. This role focuses on collecting, processing, and maintaining large-scale influencer data from social media platforms (Instagram, TikTok, YouTube, Twitter, Facebook, etc.).
The ideal candidate has strong experience in data pipelines, database management, and data validation, ensuring that our platform has up-to-date and reliable KOL (Key Opinion Leader) data.Responsibilities
Develop and maintain data pipelines to collect, clean, and store influencer profile data from multiple sources.
Implement automated workflows to refresh influencer data regularly.
Design and manage scalable influencer databases (MongoDB, PostgreSQL, BigQuery, etc.).
Ensure fast and efficient querying for influencer searches.
Implement data validation rules to prevent duplicates, missing information, or incorrect influencer profiles.
Ensure all necessary data points (e.g., images, social stats, content categories) are structured and available.
Collaborate with backend engineers to build API endpoints for data access.
Develop web scraping solutions to extract influencer data when APIs have limitations.
Work with social media APIs (Instagram Graph API, TikTok API, YouTube API, Twitter API, etc.) to fetch influencer data.
Requirements
2+ years of experience as a Data Engineer or similar role.
Strong knowledge of Python, SQL, and database management systems (MongoDB, PostgreSQL, BigQuery, or similar).
Experience in building ETL (Extract, Transform, Load) pipelines for social media data.
Experience in web scraping (BeautifulSoup, Scrapy, Selenium, Playwright, etc.)
Knowledge of data validation techniques to ensure accuracy and completeness of social data.
Familiarity with Kafka, Airflow, or other data orchestration tools.
Experience in API integrations with social platforms is a plus.
Benefits
10 days annual paid vacation
Flexible working hours
5 days and an 8-hour workday (Hybrid)
Friendly Environment
Health insurance
Learning support
Working Laptop
An office in the Shinawatra tower 3, near MRT Phahon Yothin station and BTS Phahon Yothin 24 station
Working with a wide and interesting portfolio of clients in SEA and globally
Standard perks such as free drinks and snacks in the office, team activities, trips and parties