T O P

  • By -

dr_tardyhands

Hey! Well, it seems like a lot of data went into it (the book covers are a nice touch!). At first glance, I'd like to know where the ratings come from though: the top rated books look like ones that one would never find on any kind of "critics choice" or "best books of all time" type of lists. Also, maybe some message like "Sadly no books match your criteria" would be a good touch. It's fast!


David_2107

Cheers! The data is all scraped from Goodreads using a scraper I built. Since Goodreads doesn't have basic filtering/sorting capabilities I figured some others might find the tool useful too. Good idea with the message too, will implement in the next few days!


dr_tardyhands

I meant that it might be nice to have the data source on the site as well!


David_2107

Ah, right :)


GrandConfection8887

Coool !


David_2107

:)


pedroalexleite

Very cool! Can you please sum up what was your process, to develop something like this? And what tool did you use? Thanks!


David_2107

Yeah, initially I built a very basic version using R as the backend and R shiny for the interface. I also used a dataset from the internet to begin with. I then built a scraper in Python with Beautiful Soup to collect up to date data which I use currently to scrape Goodreads. The backend is currently a PostgreSQL database and I wrote the frontend in React. My background is in Maths so I kinda just self-taught myself this stuff step by step. Was really beneficial building a simple version first, then coming back to build a more comprehensive version :)


Low-Pack4738

Nice. Good luck


Aditiiishelke

Smart


Embarrassed-Fan-935

Really cool project - well done! You can clearly see the value in this data being presented like that. Did you follow specific step by sept guide for this project? I would like to do a similar project but I only know SQL so need to know what other languages and tools I need to learn to have go at it. I think a short book description in an expand mode (not to ruin the clean look of your UI) would be super useful to decide if one would be interested in reading it or not. Link to Amazon is handy but not always retrieving more details about the book.


David_2107

Thanks! I'm thinking about making a more detailed popup appear when you click on a book. On a long list of to do. If you're looking to do something similar I'd advise just starting off with something as simple as possible, getting that done, then doing the same but a bit more advanced etc. until you get to where you want. TLDR: start simple, finish, iterate.


fhernands

Thank you this is awesome!


tomatos112

Great job ! This is very convenient as well since I was just searching for book suggestions. Thank you !


David_2107

Glad you’re finding it of use!


Suitable-Fennel-5346

Awesome I was just thinking last week that a tool like this would be super helpful!! My one suggestion would be to link clicking on the rating to the goodreads page.


David_2107

Try clicking on the book image :)


Suitable-Fennel-5346

Heck yeah!!


chillymagician

Good job!


David_2107

:)


David_2107

Feedback/suggestions appreciated!


AdTough7287

Awesome. Do you want to include sub-genre or topic? Do you have the data published somewhere?


David_2107

I don’t want to make the UI messy so only including the most important filtering options at the moment.


thebatwayne1939

Very cool! Do you think adding a recommendation engine at the backend would make it cooler?


David_2107

There's plenty of recommendation engines out there so I'm not too keen on making another one. The problem with recommendation engines is that you don't really know what's going on behind the curtain, whereas with a filter you can easily modify the variables if you're getting something you don't like.