Author |
Message |
nmcaullay
|
Posted: Mon Apr 14, 2008 11:41 pm |
|
Joined: Sun Sep 04, 2005 7:48 pm
Posts: 264
Location:
Perth, Australia
|
Hi Ralph,
I thought that the problem with the oztivo grabber was that it (tv_grab_au_reg?) was using the oldskool perl api from oztivo, and this script hadnt been updated. So it wouldnt matter if you put the right username/password in, the script would bum-out as the perl api has been discontinued? I put my oztivo username/password into shpeherd anyway... so who knows which is working...
Im probably wrong, been wrong before... lots.
Nathan
_________________ LinHES: R6 | MB: Asus M3N-H/HDMI | CPU: AMD ??Mhz
Capture: 2xHDHR DVB-T
Graphics: Onboard 8300|PSU: Corsair vx450w
Cooling: Zalman cu?,
Display: Benq xx projector
|
|
Top |
|
 |
Ralph
|
Posted: Mon Apr 14, 2008 11:55 pm |
|
Joined: Sat Dec 03, 2005 5:59 pm
Posts: 111
Location:
Sydney, Australia
|
Hi Nathan,
You're right about Will Uther's tv_grab_au_reg, which was my grabber of choice up till March 31, but unfortunately he's not in a position to be able to upgrade it to the new API at the moment. But Shepherd doesn't employ his grabber, it uses its own OzTivo grabber, and it seems to work fine, at least I don't get any error messages when it's downloading the data from OzTivo.
The good thing about Shepherd is that it automatically updates itself when anything changes with respect to various grabbers' requirements, so you don't need to worry about downloading and installing updated grabbers yourself. (The downside is is takes a lot longer to run each day, but hey, what's the hurry anyway  )
|
|
Top |
|
 |
Girkers
|
Posted: Tue Apr 15, 2008 1:29 am |
|
Joined: Tue Mar 22, 2005 9:18 pm
Posts: 1422
Location:
Brisbane, Queensland, Australia
|
I have used Manicmike's thing on page 2 and it has worked fine.
Nigel I may look at your stuff as I am from Brisbane too
Thanks.
_________________ Girkers
|
|
Top |
|
 |
manicmike
|
Posted: Tue Apr 15, 2008 4:38 am |
|
Joined: Sun Aug 28, 2005 7:07 pm
Posts: 821
Location:
Melbourne, Australia
|
Ralph wrote: But Shepherd doesn't employ his grabber, it uses its own OzTivo grabber
Last time I looked, Shepherd used the old API and didn't touch oztivo at all any longer.
Mike
_________________ ********************* LinHES 7.4 Australian Dragon *********************
|
|
Top |
|
 |
Ralph
|
Posted: Tue Apr 15, 2008 5:09 am |
|
Joined: Sat Dec 03, 2005 5:59 pm
Posts: 111
Location:
Sydney, Australia
|
manicmike wrote: Ralph wrote: But Shepherd doesn't employ his grabber, it uses its own OzTivo grabber Last time I looked, Shepherd used the old API and didn't touch oztivo at all any longer. Mike
I can't find a changelog on the Shepherd site that says when the grabber was updated, but according to my shepherd.log:
Code: SHEPHERD: Scoring grabbers on ability to efficiently provide needed data: yahoo7widget 1190 pts oztivo 280 pts yahoo7web 210 pts (inc. 35 cache pts) sbsnews_website 189 pts foxtel_swf 189 pts channelnsw_gov 189 pts acctv_website 189 pts citysearch 81 pts abc_website 28 pts ten_website 27 pts (inc. 6 cache pts) southerncross_website 0 pts Code: * Grabber yahoo7widget v1.102... up to date * Grabber abc_website v3.17... up to date * Grabber sbsnews_website v0.19-r1... up to date * Grabber oztivo v2.11... up to date * Grabber yahoo7web v0.30... up to date * Grabber foxtel_swf v0.24-r2... up to date * Grabber channelnsw_gov v0.8... up to date * Grabber southerncross_website v0.17... up to date * Grabber ten_website v1.04... up to date * Grabber citysearch v3.0.0-r1... up to date * Grabber acctv_website v0.05... up to date * Reconciler reconciler_mk2 v0.38... up to date * Postprocessor imdb_augment_data v0.37... DISABLED BY USER * Postprocessor tvdb_augment_data v0.11... DISABLED BY USER * Postprocessor flag_aus_hdtv v0.34... DISABLED BY USER * Postprocessor augment_timezone v0.21... up to date suggests it's up to date. Output while mythfilldatabase is running such as: Code: : Fetching http://********:********@minnie.tuhs.org/xmltv/ABC-NSW_2008-04-18.xml.gz... : Successfully fetched 8 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/ABC-NSW_2008-04-19.xml.gz... : Successfully fetched 3 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/ABC-NSW_2008-04-20.xml.gz... : Successfully fetched 6 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/ABC-NSW_2008-04-21.xml.gz... : Successfully fetched 7 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/SevenHD_2008-04-15.xml.gz... : Successfully fetched 1 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/SevenHD_2008-04-16.xml.gz... : Successfully fetched 1 KB. : Sleeping for 1 seconds... : Fetching http://********:********@minnie.tuhs.org/xmltv/SevenHD_2008-04-17.xml.gz... : Successfully fetched 1 KB. suggests that it's grabbing successfully from OzTivo.
|
|
Top |
|
 |
manicmike
|
Posted: Tue Apr 15, 2008 5:14 am |
|
Joined: Sun Aug 28, 2005 7:07 pm
Posts: 821
Location:
Melbourne, Australia
|
Ralph wrote: suggests that it's grabbing successfully from OzTivo.
I sit corrected. Four weeks ago it was still using the old api so they have updated it recently.
Excellent grabber, just very slow and bandwidth hungry.
Mike
_________________ ********************* LinHES 7.4 Australian Dragon *********************
|
|
Top |
|
 |
soundoff
|
Posted: Thu Apr 17, 2008 3:43 pm |
|
Joined: Tue Jan 24, 2006 1:29 am
Posts: 157
Location:
Brisbane, Australia
|
so guys.... can i get a quick bit of advice before i attack this on the weekend.
shepherd
or
new manicmike script
???
I dont really care about speed or bandwidth, it runs at 3 in the morning anyway. I just want easy to configure and reliability
|
|
Top |
|
 |
Kirk
|
Posted: Thu Apr 17, 2008 5:44 pm |
|
Joined: Mon Mar 13, 2006 2:28 am
Posts: 143
Location:
Brisbane, Australia
|
Shepherd, hands down the best grabber available. It's slow er because it's designed not to hammer the servers, and it's not bandwidth hungry because it also employs caching techniques.
Installation is easy, and once setup you can forget about it, as the grabbers are automatically updated as required.
Highly recommended.
Regards,
Kirk.
_________________ MBE/FE ~ R5F27 ~ Asus A8N-VM-CSM ~ AMD64 3500+ ~ 1GB RAM ~ 1.5TB Storage ~ Nova-T-500 ~ SH-S183A DVDRW ~ LC20M Case ~ iMON-Pad Remote FE ~ Diskless ~ Asus M2NPV-VM ~ AMD X2 BE-2350 (45w) ~ 1GB RAM ~ TT Lanbox Lite ~ iMON-Pad Remote
|
|
Top |
|
 |
soundoff
|
Posted: Thu Apr 17, 2008 7:20 pm |
|
Joined: Tue Jan 24, 2006 1:29 am
Posts: 157
Location:
Brisbane, Australia
|
|
Top |
|
 |
ajpalm
|
Posted: Fri Apr 18, 2008 3:22 am |
|
Joined: Fri Apr 18, 2008 3:19 am
Posts: 4
|
2008-04-18 19:16:31.115 Connected to database 'mythconverg' at host: localhost
Failed to fetch http://minnie.tuhs.org/xmltv/channels.xml.gz at /usr/bin/tv_grab_au line 346.
2008-04-18 19:16:31.842 ------------------ End of XMLTV output ------------------
Hi Guys,
All has been working well upto tonight, getting the following error. Appears the script isn't passing my username/password for the download.
If I copy and paste that URL into IE, it prompts for username/password. Entering those in, downloads the file correctly. so the file is there etc.
Anyone else seeing this?
Thanks!
|
|
Top |
|
 |
soundoff
|
Posted: Fri Apr 18, 2008 5:02 am |
|
Joined: Tue Jan 24, 2006 1:29 am
Posts: 157
Location:
Brisbane, Australia
|
Just installed Shepherd.
Yes its slow (20 mins!!)
Yes it has a lot of per dependencies (who cares - the instructions tell you how to install)
But WOW what a grabber. I have never had such quality data.
Added these lines to /etc/crontab to make it all automatic:
Code: # run shepherd grabber at 4:01am every day 01 4 * * * mythtv /home/mythtv/.shepherd/shepherd
# run mythfilldatabase at 4:25am every day 25 4 * * * mythtv /usr/bin/mythfilldatabase --file 1 -1 /home/mythtv/.shepherd/output.xmltv 30 4 * * * mythtv /usr/bin/mythfilldatabase --file 2 -1 /home/mythtv/.shepherd/output.xmltv
And most importantly the mrs is most impressed. Thanks guys
|
|
Top |
|
 |
Ralph
|
Posted: Fri Apr 18, 2008 5:27 am |
|
Joined: Sat Dec 03, 2005 5:59 pm
Posts: 111
Location:
Sydney, Australia
|
Which grabber are you using? ajpalm wrote: 2008-04-18 19:16:31.115 Connected to database 'mythconverg' at host: localhost Failed to fetch http://minnie.tuhs.org/xmltv/channels.xml.gz at /usr/bin/tv_grab_au line 346. 2008-04-18 19:16:31.842 ------------------ End of XMLTV output ------------------ Hi Guys, All has been working well upto tonight, getting the following error. Appears the script isn't passing my username/password for the download. If I copy and paste that URL into IE, it prompts for username/password. Entering those in, downloads the file correctly. so the file is there etc. Anyone else seeing this? Thanks!
|
|
Top |
|
 |
ajpalm
|
Posted: Fri Apr 18, 2008 8:32 pm |
|
Joined: Fri Apr 18, 2008 3:19 am
Posts: 4
|
Ralph wrote: Which grabber are you using? ajpalm wrote: 2008-04-18 19:16:31.115 Connected to database 'mythconverg' at host: localhost Failed to fetch http://minnie.tuhs.org/xmltv/channels.xml.gz at /usr/bin/tv_grab_au line 346. 2008-04-18 19:16:31.842 ------------------ End of XMLTV output ------------------ Hi Guys, All has been working well upto tonight, getting the following error. Appears the script isn't passing my username/password for the download. If I copy and paste that URL into IE, it prompts for username/password. Entering those in, downloads the file correctly. so the file is there etc. Anyone else seeing this? Thanks!
Sorry, using this one
http://www.better-access.com/KM/tv_grab_au
|
|
Top |
|
 |
deMyth
|
Posted: Sat Apr 19, 2008 7:00 pm |
|
Joined: Sat Apr 19, 2008 6:37 pm
Posts: 7
|
ajpalm wrote: Ralph wrote: Which grabber are you using? ajpalm wrote: 2008-04-18 19:16:31.115 Connected to database 'mythconverg' at host: localhost Failed to fetch http://minnie.tuhs.org/xmltv/channels.xml.gz at /usr/bin/tv_grab_au line 346. 2008-04-18 19:16:31.842 ------------------ End of XMLTV output ------------------ Hi Guys, All has been working well upto tonight, getting the following error. Appears the script isn't passing my username/password for the download. If I copy and paste that URL into IE, it prompts for username/password. Entering those in, downloads the file correctly. so the file is there etc. Anyone else seeing this? Thanks! Sorry, using this one http://www.better-access.com/KM/tv_grab_au
Yes, I am seeing this problem (/usr/bin/tv_grab_au line 346), i have created my own workaround to the problem. I have written a shell script which uses wget to bring down the channel data files to my local myth host, I then point the tv_grab_au script to my server and it works OK. My server doesn't require auth, it is used for mythweb so I didn't have too much work here to get it all going. Let me know if you want help, I am happy to share my workaround.
cheers,
deMyth
----------
|
|
Top |
|
 |
krayzie
|
Posted: Sat Apr 19, 2008 8:29 pm |
|
Joined: Sun Apr 30, 2006 1:02 am
Posts: 1
|
deMyth wrote: ajpalm wrote: Ralph wrote: Which grabber are you using? ajpalm wrote: 2008-04-18 19:16:31.115 Connected to database 'mythconverg' at host: localhost Failed to fetch http://minnie.tuhs.org/xmltv/channels.xml.gz at /usr/bin/tv_grab_au line 346. 2008-04-18 19:16:31.842 ------------------ End of XMLTV output ------------------ Hi Guys, All has been working well upto tonight, getting the following error. Appears the script isn't passing my username/password for the download. If I copy and paste that URL into IE, it prompts for username/password. Entering those in, downloads the file correctly. so the file is there etc. Anyone else seeing this? Thanks! Sorry, using this one http://www.better-access.com/KM/tv_grab_auYes, I am seeing this problem (/usr/bin/tv_grab_au line 346), i have created my own workaround to the problem. I have written a shell script which uses wget to bring down the channel data files to my local myth host, I then point the tv_grab_au script to my server and it works OK. My server doesn't require auth, it is used for mythweb so I didn't have too much work here to get it all going. Let me know if you want help, I am happy to share my workaround. cheers, deMyth ----------
deMyth,
can you please post your script.
Thanks.
|
|
Top |
|
 |