I have a few e2e projects, if that might help. While they can be deployed to AWS via the included terraform file (costs money) you can run them locally with docker. I list the projects from simplest to more complicated 1. I’d recommend starting at https://www.startdataengineering.com/post/data-engineering-project-to-impress-hiring-managers/ this is the simplest. 2. Once you have it running, and get an overview of the components( docker, ec2, Postgres), then I’d recommend looking at this article https://www.startdataengineering.com/post/data-engineering-projects-with-free-template/ to understand how the components work together. 3. Try out the pipeline with a data source if your choosing. I use https://github.com/public-api-lists/public-api-lists to get some data API. 4. Once you get a good understanding of how data is pulled and loaded along with how it’s scheduled, then I’d recommend looking at this airflow project https://www.startdataengineering.com/post/data-engineering-project-for-beginners-batch-edition/ I posted about this a while back https://www.reddit.com/r/dataengineering/comments/ygieh8/data\_engineering\_projects\_with\_template\_airflow/ Hope this helps. LMK if you have any questions.

And then try out the pipeline with a data source if your choosing. I use https://github.com/public-api-lists/public-api-lists to get some data API.

Suggest to take a look through https://github.com/public-api-lists/public-api-lists

Sounds like you're stuck in tutorial purgatory. It's time to drop the training wheels and apply the knowledge you've learned to some personal projects. Pickup pygame, or build a web scraper. Here's a list of free public api's. This might get you started. https://github.com/public-api-lists/public-api-lists

Public-api-lists (fork of original one I linked)

public-api-lists Another great repository to find good APIs for development. It has more than 4K stars on GitHub. These APIs are more inclined towards the development side. It is also organized into suitable categories.

import { useEffect, useState } from "react"; import axios from "axios"; import "./App.css"; import InfiniteScroll from "react-infinite-scroll-component"; import CharacterCard from "./components/Card"; function App() { const [characters, setCharacters] = useState([]); const [page, setPage] = useState(1); const [hasMore, setHasMore] = useState(true); const [totalPages, setTotalPages] = useState(1); const fetchData = async () => { if (page == totalPages + 1) { setHasMore(false); return; } // <-----------------------------------------------> // waiting for 1 second before fetching data to show loading spinner, you can skip this await new Promise((resolve) => setTimeout(resolve, 1000)); // <-----------------------------------------------> const res = await axios.get( `https://rickandmortyapi.com/api/character?page=${page}` ); setCharacters((prevPosts) => [...prevPosts, ...res.data.results]); setTotalPages(res.data.info.pages); setPage((prevPage) => prevPage + 1); }; useEffect(() => { fetchData(); }, []); return (

Rick and Morty characters!h1> Loading...h4>} endMessage={

Yay! You have seen it allb> p> } > {/* Map over characters array and return JSX */} {characters.map((character, index) => ( ))} InfiniteScroll> div> ); } export default App;

This project was conceived as a coding challenge and a demonstration of integrating modern web technologies into a cohesive application. The core of this project involves leveraging GraphQL to interact with the open-source Rick and Morty API, a task I often set for potential hires.

export const apolloClient = new ApolloClient({ uri: "https://rickandmortyapi.com/graphql", cache: new InMemoryCache({ typePolicies: { Query: { fields: { characters: { keyArgs: false, merge(existing: Characters, incoming: Characters) { return { ...incoming, results: [ ...(existing?.results || []), ...(incoming?.results || []), ], } satisfies Characters; }, }, }, }, }, }), });

Hello, my fellow CS students! Are there any Rick & Morty fans here? Because I've just created an app called Portalpal for my final project. It's a fun little app designed to explore the Rick & Morty universe. With Portalpal, you can view, search, paginate, and filter characters. Additionally, you have the option to filter characters by episodes and locations. For the data, I utilized the rickandmorty API, which you can check out here: https://rickandmortyapi.com/. If you'd like to give it a try, here's the link to my app: https://portalpal.vercel.app/. I built it using React 18, and it took me about a month. I'm really proud of how it turned out! If you're interested, you can also find the source code for the app on my GitHub repository: https://github.com/kyawzinhtett/portalpal. Feel free to open an issue if you discover any errors.

Just a small app consuming the Rick and Morty API showing some basic stats of each character such as last known location, species and what episode(s) they appear in.

Checkout https://rickandmortyapi.com and their https://rickandmortyapi.com/graphql

Click the guys name in the footer. It’ll take you to his GitHub profile. There you can find the source code to the site and the API.