{"id":174,"date":"2024-11-11T06:49:22","date_gmt":"2024-11-11T05:49:22","guid":{"rendered":"https:\/\/www.systemdeveloper.nl\/tech\/?p=174"},"modified":"2024-11-28T13:55:10","modified_gmt":"2024-11-28T12:55:10","slug":"building-a-sports-data-api-with-mongodb-and-flask","status":"publish","type":"post","link":"https:\/\/www.systemdeveloper.nl\/tech\/building-a-sports-data-api-with-mongodb-and-flask\/","title":{"rendered":"Building a Sports Data API with MongoDB and Flask"},"content":{"rendered":"

In this project, we set out to create a flexible, high-performance sports data API to manage complex data on football teams, players, matches, and competitions. Using the Data Sports Group API as our data source, we developed a process to import this data into MongoDB, ensuring efficient storage and quick access. We then built a custom Flask API to provide endpoints that deliver this data to applications, making the data easy to retrieve and integrate. Here’s an overview of how we approached this project, including a detailed example to illustrate the process.<\/p>\n\n\n

If you’d like to get started right away, read Setting Up MongoDB with Python for Data Import and API Access<\/a><\/p>\n\n\n

Step 1: Data Import from the Data Sports Group API<\/h3>\n\n\n

We began by writing scripts to fetch data from the Data Sports Group API. The data, provided in JSON format, included details about players, teams, squads, and other football-related information. Here’s a look at the main steps:<\/p>\n\n\n

    \n
  1. \nAPI Requests<\/strong>: Using the requests<\/code> library in Python, we pulled data from various endpoints, such as those for team details, player statistics, and match information.<\/li>\n\n\n\n
  2. \nMongoDB Collections<\/strong>: The data was organized into multiple MongoDB collections:
      \n
    • \npeople<\/code><\/strong>: Holds detailed data about players, indexed by fields such as people_id<\/code> and membership_id<\/code>.<\/li>\n\n\n\n
    • \nteam<\/code><\/strong>: Stores team details, including unique identifiers and team metadata.<\/li>\n\n\n\n
    • \nsquad<\/code><\/strong>: A streamlined collection containing team summaries and lists of players within each team.<\/li>\n<\/ul>\n<\/li>\n\n\n\n
    • \nField Management<\/strong>: We carefully structured fields in MongoDB, using indexes to improve search speed and controlling field types to maintain data consistency. For example, fields such as goals<\/code> were kept as strings to match the original format, avoiding issues with data conversion.<\/li>\n<\/ol>\n\n\n

      Step 2: Building the Flask API<\/h3>\n\n\n

      To provide easy access to our sports data, we developed a Flask API that served as a direct interface with MongoDB. This API allowed for flexible queries, enabling users to retrieve only the data they needed. Key features of the Flask API included:<\/p>\n\n\n

        \n
      1. \nFlexible Endpoints<\/strong>: The API included multiple endpoints, allowing access to player, team, and competition information. For example, the \/team\/<team_id>\/players<\/code> endpoint allows users to retrieve all players associated with a specific team, optionally filtering by player statistics or career details.<\/li>\n\n\n\n
      2. \nCase-Insensitive Queries<\/strong>: We implemented case-insensitive search functionality to improve user experience. For example, searching for a player’s common_name<\/code> would return the correct result regardless of capitalization.<\/li>\n\n\n\n
      3. \nOptimized JSON Output<\/strong>: By setting ensure_ascii=False<\/code> in json.dumps()<\/code>, we ensured that JSON responses were readable without unnecessary Unicode escaping.<\/li>\n\n\n\n
      4. \nDatabase Configuration<\/strong>: The database connection was abstracted in a separate file, db.py<\/code>, where the get_db()<\/code> function managed MongoDB connections. This design streamlined the code and made it easy to modify database configurations without changing core API logic.<\/li>\n<\/ol>\n\n\n

        Example: Fetching Players from a Team<\/h3>\n\n\n

        Here’s an example of how our system works. Suppose we want to retrieve a list of players from a specific team. With our Flask API, we can accomplish this through the following endpoint:<\/p>\n\n\n

        \nCopied!<\/span>