PLI - Oztivo SQLITE EPG Plugin Script *NEW*

**nfnovice** · 31-08-09, 01:03 PM

just checked this out and the foxsports data is just not there at oztivo beyond today

so neither the normal oztivo nor the one-off script can collect data which aint there
cheers

**florra** · 31-08-09, 09:31 PM

Thats strange because when I click on your link I can see the xml files for the next 7 days for FS1, 2 & 3. Are we looking at the same thing?

**nfnovice** · 01-09-09, 08:21 AM

They are there now - Have a look at the date and time beside the FSX files
31/08/2009 14:32 - hmmmm that would be after my post and before yours

and further more my bet is that if you run the scripts now they will work

you have to look a bit deeper sometimes mate
it might be my script
but oztivo gets full credit for the data (whether its there or not)

**florra** · 01-09-09, 10:27 PM

Please don't get me wrong, I wasn't having a go at your script. Its more likely that I haven't configured something correctly.

By the way, still no go with the updating. I guess I'll just have to go back to the beginning and start afresh. Thanks for the follow up.

**ogo99** · 01-09-09, 10:56 PM

I only usually get no data except now/next on Cbeebies and a few other unimportant channels.

took me a while to get working correctly but now it's so much better than just now/next, even if the EPG sucks compared to the IQ1.

**haris2887** · 13-10-09, 09:03 PM

hi all i am having trouble getting this to work on my DM7000 with HDD installed..

i have added my PASSword and username for oztivo_au.txt

here it what my OZTIVO AU .txt file looks like..

OZTIVOAU.cfg=

name=OZTIVO AU
command=/var/bin/oztivo_au.sh
mapfile=oztivo_au.dat
options=
type=xmltv
numOfDays=3
timeOffset=0
use_cron=true
epgLocation=/hdd/epg.db

#=debug=0 show nothing, debug=1 show highlevel progress, debug=2 show doing things, debug=3 show not doing things, debug=4 show everything
debug=2
#=http:// or ftp:// depending on your server
protocol=http://
#=oztivo UserName and Password are case sensitive
user=*********:*********
#=user is needed Y or N
userneeded=Y
#=server name and directory
www=www.oztivo.net/xmltv/
#=name of file at oztivo
availfile=datalist.xml.gz
#=build the cache here
cachedir=/media/hdd/
#=channel mapping file name
chnlfile=oztivo_au.dat
#=temporary availabilty file (no spaces)
tempfile=/var/tmp/chnltemp.xml
#=remove channel data file once loaded into epg - you might keep it if you are debugging
cleanup=Y
#=where to put downloaded channel files while we work on them
datadir=/var/tmp
#=server for other local boxes - will keep files in serverdir below
server=N
#enigma2 wil only download, cache and serve files - will not add to sqlite epg separate .py plugin
e2=N
#=serverdir for other local boxes
serverdir=/media/hdd/
#=add unknown channels to channel mappings file
learnchnls=Y
#=either learnas UNKNOWN or IGNORE - take your choice
learnas=UNKNOWN
#program used to convert xml to sqlite epg
convert=/var/bin/db_epg

my problem is that i can retreave the EPGDATA FINE.like i have EPG.db etc files on my hdd but
when i press the Red botton no EPG shows UP...

EDIT:
AFTER an hour of playing around i have KIND of got it working..
LIKE i can see the EPG cache contents etc..via the OZTIvo script
BUt the actual EPG when i press the Red button is SCREWED..
on 80% of the channels it only shows now ON, then next program then there is a 3-4 hours GAP followed by another Program followed by another gap etc...

**nfnovice** · 14-10-09, 07:52 AM

strange gaps in the past have been linked with daylight savings or time settings
which time zone are you in ?
try another setting in the same time zone might make a difference
always blow away the epg.db and reboot before you run again to start with a clean slate
if you cant crack it - set your debug = to 3 or higher and pm me the log
cheers

**haris2887** · 14-10-09, 12:21 PM

i am currently in GTM 10+ melbourne,sydney..
i currently on have Now and NExt programs on the EPG...
i have checked multiple time thats Sqlite is Disabled...

do my Config looks correct for SAVING EPG TO HDD...

**jgm** · 14-10-09, 01:35 PM

Change time to GTM 10+ Hobart. The Europeans haven't caught up with the latest daylight savings changes in oz.

**haris2887** · 14-10-09, 02:04 PM

i have changed the dayligh savings time to no sucess...
i can now only get NOW and Next prograns (like Enigma EPG)...
i am going o try deleting everything (epg related) from HDD and redownload the EPG...

**nfnovice** · 14-10-09, 02:28 PM

Change your cachedir line to this

cachedir=/media/hdd/epgcache/

at least that way you have a set directory without all the other staff

change your debug line to this

debug=3

then delete /media/hdd/epg.db
reboot
then run /var/bin/oztivo_runnow.sh
It runs in the background and will take a while (maybe 40 minutes or so) ..
then check out /tmp/oztivo_au.sh.log
it should tell you of any errors

if you cant get it or see it then copy /tmp/oztivo_au.sh.log to here (or me)
note that the log file disaapears after a reboot as part of tmp directory cleanuo.

**ogo99** · 14-10-09, 02:59 PM

I'm still missing all information on Nickelodeon, CBeebies and a few other channels. Whilst not important, do you guys get that info ?

**nfnovice** · 14-10-09, 03:16 PM

I never go to those channels - but you are right ogo - they are missing
as they used to be there - my guess is a change in frequency / sid or something
try this it usually works for me ..

1. Go to the channel mapping part of the plugin
2. map both as UNKNOWN
3 save and save out of the plugin
4. go back into the plugin and map them to the channels again
5. delete any of the cache files for those channels from your cachedir
6 run the plugin and they should populate ..

*NOTE* florra pointed out earlier in this thread a problem with the one-off plugin
on closer examination I have found a bug and will upload the new version real soon
so at this point one_off script will not function correctly - sorry bout that

**haris2887** · 14-10-09, 10:03 PM

ok ill set Debug to 3 and send you the log..
then run /var/bin/oztivo_runnow.sh ----how do i do this step...........

also it says use a UNIX editor to edit the files with username

assword etc.., Can i use notepad ?

**nfnovice** · 15-10-09, 08:16 AM

no - dont use notepad.
find notepad++ on the internet great editor for what you need (always make sure files are saved in unix format)

then run /var/bin/oztivo_runnow.sh ----how do i do this step...........

telnet into the box, signin and type

/var/bin/oztivo_runnow.sh

from the log you sent me via PM - I have these comments

Originally Posted by haris2887

Config Epg File : /hdd/epg.db
Actual Store Directory : /media/hdd

these two lines show that your epg.db is pointed to your hard drive in both oztivo config and epg config. so thats good.

debug 2

this line shows you havent changed the debug level to 3 (like I asked.)

you are definitely getting the list of chanels from oztivo and reading thru that file ok
the long run through channels is just reading the list that it got.

however that log is not processing any chanels into epg.db
if you had debug higher it would tell us why ...
which could be one of a few reasons
1. chanels are not mapped
2. you already have files in your cachedir

to test both at once
- change to debug = 3 in oztivo_au.txt
- run rm /media/hdd/epgcache/*
- telnet into the box, signin and type

/var/bin/oztivo_runnow.sh

**haris2887** · 16-10-09, 12:22 AM

ok after pulling my har i got it Half working..
the EPG..
There are Huge chuink missing in the DATA eg.
if a program starta at 1:am and ends 1:50 it will show it find but from 2:00 onwards to 4:00 there is a gam and the is notinh on..
there are gap all over the place..

i also tried different time zones to no AVIL...

i set debug to level 3
and sent you the LOG..
i hve a strong feeling it is a time problem but i DONT know...
hoe can i post a full LOGG..

**nfnovice** · 16-10-09, 08:42 AM

ok haris - got the first part of your log by pm - it cuts off right at the point it was going to show me something.
the log shows that you didnt do this command like I asked
- run rm /media/hdd/epgcache/*
because all your cache files are there.
if they are there - then script assumes you have those details already and will not redo them
so
1. run rm /media/hdd/epgcache/* (which blows away your cache)
2. rm /hdd.epg.db (which blows away your current epg.db)
3. reboot (which recreates your epg.db from scratch
4. run /var/bin/oztivo_runnow.sh (which runs the script in the background)

wait 40 minutes then check out your epg and check out the log.
read the log - its all straight forward
unmappped - means you havnt mapped this channel and dont want that data
too old - means its in the past
too far in future - more than today + no of days to grab
already got it - means your cache shows this file hasnt changed since you last picked it up.

now a good section of log picking up and processing 7central data for the 16th looks like this

too old 7CEN_2009-10-15.xml.gz
wget -O /var/tmp/7CEN_2009-10-16.xml.gz
7CEN_2009-10-16.xml. 100% |*****************************| 3341 00:00 ETA
Connecting to [65.49.60.197]:80
gunzip /var/tmp/7CEN_2009-10-16.xml.gz
/var/bin/db_epg -t xmltv -d /var/epg.db -f /var/tmp/7CEN_2009-10-16.xml -o 0 -h 216 -m /var/tuxbox/config/dbepg/oztivo_au.dat -g -e -c 1
Setting encoding to ISO-8859-1
already got it 7CEN_2009-10-17.xml.gz

so if you see the Setting Encoding to ISO line and no error after it - then it is adding stuff to your epg.db nicely

if your epg still looks shabby or with gaps return to piont 1 above firstly or
fix your timezone issues like previously recommended.
cheers

**haris2887** · 16-10-09, 12:45 PM

ok the timezone issues.
Do i just change the Timzone to Hobart ?
i did that it was the same..
then i rebooted, still the same,
then
rm /hdd/epg.db
rm /hdd/epgcache/*
then /var/bin/oztivo_runnow.sh
timezone problems not sure i will try darwin..

**nfnovice** · 16-10-09, 12:56 PM

mate Darwin is +9.30 and Hobart is +10 - its either one or the other
the trick is to pick another in your same timezone
the part that seems to create errors is the daylight saving part withing the zone files
so
if its darwin - try adelaide (+9.30)
if its hobart - try brisbane (+10.00)
thats sort of thing

maybe if you tell us your timezone and someone else in the same time zone can tell us if it works for them and what settings they have.

next you need to set your timezone - then clean out your old epg stuff - then reboot and run it not change your time zone after you run it ...