Click here to go to the forum index Click here for the home page
 
Author Message

<  Computer connections  ~  as2mei - a replacement for rt2mei?

Page 22 of 23
Goto page Previous  1, 2, 3 ... , 21, 22, 23  Next
db82407
Posted: Sat May 21, 2016 11:33 am Reply with quote
Joined: 11 Sep 2005 Posts: 23 Location: London
I've taken a quick look at the schedulesdirect.org data ($25/y - free 7-day trial).

It's provided in JSON, but they don't document the API and expect you to use one of their approved open source apps to grab the data.

I used mc2xml for my initial grab. The first disappointment is that it only has freesat data, not freeview (except for Wales). Here's the lineup's it offered me for the UK:

0: Antenna (CF31) (Antenna)
1: BSkyB - Channel Isles (United Kingdom) (Satellite)
2: BSkyB - Eire (Ireland) (United Kingdom) (Satellite)
3: BSkyB - England (United Kingdom) (Satellite)
4: BSkyB - Northern Ireland (United Kingdom) (Satellite)
5: BSkyB - Scotland (United Kingdom) (Satellite)
6: BSkyB - United Kingdom (United Kingdom) (Satellite)
7: BSkyB - Wales (United Kingdom) (Satellite)
8: Freesat - Channel Isles (United Kingdom) (Satellite)
9: Freesat - England (United Kingdom) (Satellite)
10: Freesat - Northern Ireland (United Kingdom) (Satellite)
11: Freesat - Scotland (United Kingdom) (Satellite)
12: Freesat - Wales (United Kingdom) (Satellite)
13: Freeview - Wales (Wales) - Cable (London) (Cable)
14: Virgin Media Brackla - Cable (Watford) (Cable)
15: Virgin Media Cardiff - Cable (Cardiff) (Cable)
16: Virgin Media Cardiff - Digital (Cardiff) (Cable)


I chose 9: Freesat - England (United Kingdom) (Satellite)

By default, it downloaded all channels in this lineup for all dates.
It only took a few seconds and produced a 66Mb XML file.


This had many duplicates, as it contained all BBC regions etc,
but I could have limited the channels I grabbed.

The last data grabbed was for 28th May, so it looks like only 7 days of data.

I was more interested in the quality of the data, and the description is not very detailed. For example:
<programme start="20160521223000 +0000" stop="20160521235500 +0000" channel="I101.24324.schedulesdirect.org">
<title lang="en">Dream House</title>
<desc lang="en">When a successful publisher quits his New York City job to relocate to New England with his wife, they discover that their perfect new home was where a brutal murder committed against previous residents was committed.</desc>

There was lots of meta data containing credits and film classification (by multiple agencies), and a star rating 1.5/4 for the film above.


Here's a few more examples:

<programme start="20160521221000 +0000" stop="20160521234000 +0000" channel="I102.50059.schedulesdirect.org">
<title lang="en">Last Chance Harvey</title>
<desc lang="en">With his dead-end jingle writing job on the line, Harvey Shine flies to London for his daughter's wedding. After touching down however, Harvey discovers that his daughter's stepfather will be the one walking her down the aisle. Devastated, Harvey flees the celebrations, but misses his plane. Drowning his sorrows in the airport bar, he encounters Kate, suffocated by her interfering mother, and unlucky in love.</desc>


<programme start="20160521225000 +0000" stop="20160522010500 +0000" channel="I104.17155.schedulesdirect.org">
<title lang="en">Savages</title>
<desc lang="en">Three California pot growers wage a seemingly unwinnable war against a Mexican drug cartel that wants to take over their business.</desc>

<programme start="20160521223000 +0000" stop="20160522004000 +0000" channel="I300.21494.schedulesdirect.org">
<title lang="en">Case 39</title>
<desc lang="en">When social worker Emily Jenkins takes 10-year-old Lilith Sullivan into care, little does she know that the girl has demonic powers that spell doom for anyone who crosses her path.</desc>


So in summary:
it's only a 7 day feed
it's freesat, not freeview (I'm not sure how different these are?)
the description is not much better than the freeview EPG
it costs ~15/y
on the positive side, it was fast to download Smile


If you'd like any other tests on schedules-direct data, let me know before my 7-day trial expires!

--
Derek

_________________
TF5800, IA On, TS On, F/W: MS6 Recommended F/W 12/9/2009 -Sy
TAPs: EPG2MEI v0.96; MyStuff 6.5; Font Manager 1.0d; Extend v1.7; SecCache (UK) v0.4; EIT Sub (Game) v0.6; MyInfo B5.6; TF5000 Display v1.53;
View user's profile Send private message
db82407
Posted: Sat May 21, 2016 11:38 am Reply with quote
Joined: 11 Sep 2005 Posts: 23 Location: London
I'm not sure mc2xml is going to be our saviour either.

This link describes mc2xml feeds:
http://mc2xml.hosterbox.net/

ATLAS Metabroadcast is their 2nd listed feed; they also have subscription feeds, including schedules-directs (which is why I used mc2xml in my last post to grab schedules-direct data).

Their primary feed is from microsoft, by pretending to be a media centre (hence mc2xml), but this is described as legacy.

--
Derek

_________________
TF5800, IA On, TS On, F/W: MS6 Recommended F/W 12/9/2009 -Sy
TAPs: EPG2MEI v0.96; MyStuff 6.5; Font Manager 1.0d; Extend v1.7; SecCache (UK) v0.4; EIT Sub (Game) v0.6; MyInfo B5.6; TF5000 Display v1.53;
View user's profile Send private message
db82407
Posted: Sat May 21, 2016 11:50 am Reply with quote
Joined: 11 Sep 2005 Posts: 23 Location: London
digiguide have an api
https://digiguide.tv/api/documentation/

but it has similar terms to Atlas:

If you are thinking about using the Digiguide API to retrieve lots of content across a large range of channels and/or dates then this is not the use-case for the Digiguide API and you will most likely hit the rate limits and become subsequently banned; the API is for ad-hoc requests to complete a specific task at a point in time, for example, producing a TV Guide app for a smart phone; and is not a way to access the Digiguide Content so as to store in your own database. In circumstances like this, please contact us for a Digiguide Data Feed quote

_________________
TF5800, IA On, TS On, F/W: MS6 Recommended F/W 12/9/2009 -Sy
TAPs: EPG2MEI v0.96; MyStuff 6.5; Font Manager 1.0d; Extend v1.7; SecCache (UK) v0.4; EIT Sub (Game) v0.6; MyInfo B5.6; TF5000 Display v1.53;
View user's profile Send private message
EMJB
Posted: Sat May 21, 2016 12:34 pm Reply with quote
Frequent contributor Joined: 08 Jul 2005 Posts: 3620 Location: Maldon Essex
Thanks for your inputs, Derek.

db82407 wrote:
...It only took a few seconds and produced a 66Mb XML file.
Unfortunately that looks like a killer for users of slugs & ASUSes unless there is a way of downloading very much smaller chunks.

EMJB

_________________
Silver 5800, Board Rev 1.2, MS recomm F/W, Sudbury Tx, varying TAP config
View user's profile Send private message
db82407
Posted: Sat May 21, 2016 12:55 pm Reply with quote
Joined: 11 Sep 2005 Posts: 23 Location: London
EMJB wrote:
Thanks for your inputs, Derek.

db82407 wrote:
...It only took a few seconds and produced a 66Mb XML file.
Unfortunately that looks like a killer for users of slugs & ASUSes unless there is a way of downloading very much smaller chunks.

EMJB


You can configure channels downloaded and max duration in hours using mc2xml; however if I chose to use schedules-direct, I'd find a way to get their data directly, or via some other app than mc2xml which is a closed x86 binary.

--
Derek

_________________
TF5800, IA On, TS On, F/W: MS6 Recommended F/W 12/9/2009 -Sy
TAPs: EPG2MEI v0.96; MyStuff 6.5; Font Manager 1.0d; Extend v1.7; SecCache (UK) v0.4; EIT Sub (Game) v0.6; MyInfo B5.6; TF5000 Display v1.53;
View user's profile Send private message
mstombs
Posted: Sat May 21, 2016 3:21 pm Reply with quote
Frequent contributor Joined: 31 Dec 2006 Posts: 935
mythtv users have a perl script to grab schedules-direct info

https://github.com/kgroeneveld/tv_grab_sd_json

but if its no better than the broadcast epg looks like extended info will be no more in a months time, at least the Toppy will enjoy having more free memory I am sure!


Last edited by mstombs on Sun May 22, 2016 8:15 pm; edited 1 time in total
View user's profile Send private message TF5800
birdman
Posted: Sun May 22, 2016 2:12 am Reply with quote
Frequent contributor Joined: 13 Dec 2006 Posts: 1758 Location: Hitchin, HERTS Tx: Sandy Heath
http://wiki.xmltv.org/index.php/Britain_and_Ireland also mentions scripts to get data from http://tvguide.co.uk/, and The Guardian.
No idea what the data is like, though.

_________________

Toppy: TF5800PVR/250 - Black, now 1TB WD10EURX
F/W: MS6 Recommended F/W 12/9/2009 -FmVrXp+BmC0CbFsIPsUUuWfZXl,
Loader: C5.14, Hardware: 1.01
TAPs: SecCache (UK) v0.4; EPG2MEI v0.96; FontManager 1.0d; QuickJump 1.71; MhegOnOff(Now1) A3; EIT Sub v0.6; MyStuff 6.6
USB connected: SheevaPlug with Debian wheezy
Sig mostly from MyInfo on 26/10/09
View user's profile Send private message
EMJB
Posted: Sun May 22, 2016 9:09 am Reply with quote
Frequent contributor Joined: 08 Jul 2005 Posts: 3620 Location: Maldon Essex
birdman wrote:
... http://tvguide.co.uk/ ...No idea what the data is like, though.
Seems to be 7 days only.

_________________
Silver 5800, Board Rev 1.2, MS recomm F/W, Sudbury Tx, varying TAP config
View user's profile Send private message
Bizman
Posted: Sun May 29, 2016 8:32 pm Reply with quote
Frequent contributor Joined: 06 Apr 2010 Posts: 1700
It's all gone quiet again, is there anything of use either here or perhaps here?

_________________
TF5810, F/W: 5.15.09T 4/9/2009 -FmTe+EzHsVb
TAPs: EIT Sub (Game) v0.6; SecCache (UK) v0.4; MHEG On/Off A3; MPDisplayLITE V1.2; MyInfo B5.6; PruneEPG 1.0; EPG2MEI v0.96; QuickJump 1.72; Extend v1.7; (fsSave 1.1);
Sig generated by MyInfo on 3/8/17

Other TAPs : FsCheck, Channel Organiser. PSU Caps 7/2/2011 Tx: Mendip. TV: Samsung (32"), NSLU2, STB: Labgear FV300. PC Acer Aspire One with Win7 Starter
View user's profile Send private message
db82407
Posted: Mon May 30, 2016 11:05 am Reply with quote
Joined: 11 Sep 2005 Posts: 23 Location: London
Bizman wrote:
It's all gone quiet again, is there anything of use either here or perhaps here?


The FreeGuide website linked from your 2nd link:
http://www.artificialworlds.net/freeguide/Main/HomePage

says: "
Note: If you are in North America, during the install you may choose the "United States (free alternative - na_dtv)" or "Canada (free alternative - na_dtv)" to get free TV listings. Alternatively you can pay for an account with Schedules Direct so you can download listings: SignUpForSchedulesDirect"

- so it's only free in north america; otherwise it's a schedules direct subscription.

The XMLTV stuff in your first link is a comprehensive set of perl scripts for grabbing TV listings from many sources, but AFAIK it does not have any free sources of its own. It has grabbers that screen scrape tv listings sites, which are slow, usually only 7 days and the extended description is generally shorter than the atlas/metabroadcast offering.

I've tested XMLTV grabbers against uk-tvguide, digiguide and the guardian. digiguide has a robots.txt file indicating it does not welcome screen scrapers, I'm sure other listings sites will follow if they see a large rise in screen scraping.

uk-tvguide gave the best results:

<programme start="20160527210000 +0100" channel="film4.tvguide.co.uk">
<title lang="en">Escape Plan (2013)</title>
<desc lang="en">An expert takes a contract from the CIA to test a maximum security prison by trying to break out of it , but he soon discovers he has been duped and that his captors intend him to stay inside forever. He hatches a plan to escape, but to succeed he will need the help of a long-term convict - who wants his own freedom in return for assistance. Thriller, with Sylvester Stallone and Arnold Schwarzenegger.</desc>
<date>2013</date>
<category lang="en">Prison Drama</category>
<category lang="en">Films</category>
<subtitles type="teletext" />
<star-rating>
<value>6.8/10</value>
</star-rating>
</programme>

--
Derek

_________________
TF5800, IA On, TS On, F/W: MS6 Recommended F/W 12/9/2009 -Sy
TAPs: EPG2MEI v0.96; MyStuff 6.5; Font Manager 1.0d; Extend v1.7; SecCache (UK) v0.4; EIT Sub (Game) v0.6; MyInfo B5.6; TF5000 Display v1.53;
View user's profile Send private message
EMJB
Posted: Mon May 30, 2016 8:11 pm Reply with quote
Frequent contributor Joined: 08 Jul 2005 Posts: 3620 Location: Maldon Essex
I'm still waiting for authorisation to get access to the Red Bee data - perhaps the relevant guy has been on leave.

EMJB

_________________
Silver 5800, Board Rev 1.2, MS recomm F/W, Sudbury Tx, varying TAP config
View user's profile Send private message
EMJB
Posted: Sat Jun 04, 2016 7:35 pm Reply with quote
Frequent contributor Joined: 08 Jul 2005 Posts: 3620 Location: Maldon Essex
It would appear that metabroadcast "jumped the gun" and revoked my key 3 days early, in spite of only requesting 24 hour chunks.

EMJB

_________________
Silver 5800, Board Rev 1.2, MS recomm F/W, Sudbury Tx, varying TAP config
View user's profile Send private message
mstombs
Posted: Tue Jun 07, 2016 9:46 am Reply with quote
Frequent contributor Joined: 31 Dec 2006 Posts: 935
Code:
failed to open stream: HTTP request failed! HTTP/1.1 403 Forbidden
 in /public/as2mei/as2mei.php on line 1631


Radiotimes 2011:
Quote:
both Radio Times and MetaBroadcast are committed to the XML TV community


Metabroadcast 2016:
Quote:
Our APIs are not a good fit for those who wish to download data for personal use, eg for an eyeTV, MythTV or other similar devices. Indeed, this use has been specifically forbidden in our API terms for more than two years.
View user's profile Send private message TF5800
Bizman
Posted: Wed Jun 15, 2016 12:05 pm Reply with quote
Frequent contributor Joined: 06 Apr 2010 Posts: 1700
EMJB wrote:
I'm still waiting for authorisation to get access to the Red Bee data - perhaps the relevant guy has been on leave.

EMJB
Over two weeks have passed, perhaps he has resigned ! Smile

_________________
TF5810, F/W: 5.15.09T 4/9/2009 -FmTe+EzHsVb
TAPs: EIT Sub (Game) v0.6; SecCache (UK) v0.4; MHEG On/Off A3; MPDisplayLITE V1.2; MyInfo B5.6; PruneEPG 1.0; EPG2MEI v0.96; QuickJump 1.72; Extend v1.7; (fsSave 1.1);
Sig generated by MyInfo on 3/8/17

Other TAPs : FsCheck, Channel Organiser. PSU Caps 7/2/2011 Tx: Mendip. TV: Samsung (32"), NSLU2, STB: Labgear FV300. PC Acer Aspire One with Win7 Starter
View user's profile Send private message
EMJB
Posted: Wed Jun 15, 2016 12:16 pm Reply with quote
Frequent contributor Joined: 08 Jul 2005 Posts: 3620 Location: Maldon Essex
Bizman wrote:
EMJB wrote:
I'm still waiting for authorisation to get access to the Red Bee data - perhaps the relevant guy has been on leave.

EMJB
Over two weeks have passed, perhaps he has resigned ! Smile


Chased them at the end of last week, but no response. Has anyone else tried?

EMJB

_________________
Silver 5800, Board Rev 1.2, MS recomm F/W, Sudbury Tx, varying TAP config
View user's profile Send private message

Display posts from previous:  

All times are GMT + 1 Hour
Page 22 of 23
Goto page Previous  1, 2, 3 ... , 21, 22, 23  Next

Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum