-
Notifications
You must be signed in to change notification settings - Fork 0
/
todo.txt
40 lines (25 loc) · 1.17 KB
/
todo.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
So now when i destroy all it also destroys the critic and creates a new critic i think
update scraper to add date
fix the damn end of movies or see why it is repeating movies
it's hard to believe i did 500 movies?
center the css
if you click back and forth on critics and go back to the main page it does another pull? or does it?
Next couple of days
Look at mobile
Look at creating some sort of intro / instructions
Test actual api call for recent scrape and invidivual movie scrape
Set up the scheduler / cron job
Later
Fix when movies are loaded again that it retains old movies and pulls duplicates to reduce api calls.
Remove the code for multiple moves on a page
See why scraper fails sometimes despite rescue
Figure faster way to do against the grain
Scraper
- record video showing code and app
- Javascript tests with mocha or jasmine
Bugs
- figure out why in theater scraper fails at "rought night" saying
NoMethodError: undefined method `search' for nil:NilClass
/Users/nickdamiano/code/critic-match/critic-match/app/jobs/metacritic_scraper.rb:94:in `scrape_one_movies_reviews'
Notes
Is there something inherently wrong about the database models that makes this so slow