StreamingSoundtracks.com
Search

 

VIP
Subscribe to become a VIP member of SST!

· Request More Often
· Unshared Requests
· Request Countdown Timer
· Request Ready Indicator
· Your Request History
· Access To The VIP Forum
· Add More Favorites

:: Click Here To Upgrade ::

:: Give VIP as a Gift ::

Click Here To Listen

Follow Us


Donation Meter


Make donations with PayPal!
Monthly Goal:
$500.00

Need:
$120.80

26 Donations:
$379.20

Death.FM (Nov-28) blackvision $4.2
StreamingSoundtracks.com (Nov-27) Victor $10.00
StreamingSoundtracks.com (Nov-27) Anonymous $25.00
StreamingSoundtracks.com (Nov-27) alien_avatar $13.34
Death.FM (Nov-27) jorrizza $16.66
StreamingSoundtracks.com (Nov-25) Anonymous $25.00
StreamingSoundtracks.com (Nov-24) martino $10.00
Death.FM (Nov-23) SeclusionSolution $50.00
Death.FM (Nov-22) Windsor $5.00
Death.FM (Nov-21) dred77 $5.00
1980s.FM (Nov-21) GrkTrg $25.00
StreamingSoundtracks.com (Nov-20) voda $15.00
StreamingSoundtracks.com (Nov-20) molossus $10.00
StreamingSoundtracks.com (Nov-19) Ghostkeeper $15.00


 


Last Month's Donors
Death.FM (Oct-31) diginferno $50.00
Death.FM (Oct-31) postmasterdclxvi $30.00
StreamingSoundtracks.com (Oct-30) Victor $5.00
Death.FM (Oct-30) picsaleves $5.00
StreamingSoundtracks.com (Oct-30) voda $20.00
StreamingSoundtracks.com (Oct-29) Luvmusic $10.00




Windows Phone App

Android App

SSTore



:: SSTore ::


Windows Media

Partners


:: Link To Us ::
:: Add Your Link ::


upload just in time

 
Post new topic   Reply to topic    StreamingSoundtracks.com Forum Index -> Ideas
View previous topic :: View next topic 
Author Message
Germany blablublaber
Cadet 4
Cadet 4



Joined: Sep 04, 2012
Member#: 33525
Posts: 16
Location: munich, english garden

blablublaber is offline View user's profile Send private message View blablublaber's Favorites
Skype Name
PostPosted: Sat Feb 09, 2013 5:29 am   Post subject: upload just in time Reply with quote


the current overwriting all tracks in SST will probably take another 5 weeks
until it is finished we will still see "skippd tracks" in the Q

my suggestion is in addition to the slow upload all files to build an "on demand upload"
any track that is in the Q should get "priority" thus we would stop the skipping tracks problem in about one hour and not end of march

it could be accomplished by something like a cronjob asking the database about whats in the Q and not jet updated, and just getting these files f.e. using scp form JERICS backup at home

of course i dont know the internal sst databases so i am only writing some psudo code:
## database
create table sst_updates( songID int, asin varchar(255) , timestamp int , primary key(songID));
## cronjob all 10 min:
foreach
(select songID from sst_Q left outer join sst_updates using songID Wink do
scp JERRIC@home:/backup/songID SST:/music/songID && mysql insert into sst_updates songID,asin, time();

done
Poland molossus VIP (subscribed member)
Vice Admiral (Moderator)
Vice Admiral (Moderator)



Joined: Aug 09, 2005
Member#: 11167
Posts: 2528
Location: Szczecin and Warsaw (Poland)

molossus is offline View user's profile Send private message View molossus's Favorites
PostPosted: Sat Feb 09, 2013 12:25 pm   Post subject: Reply with quote


Sounds interesting.
_________________
"The piano keys
Are black and white
But they sound like a million colours in your mind"
(from Spider's Web by Katie Melua)
---
Avatar is from work of art by Drew Struzan
Romania diginferno
Admiral (Administrator)
Admiral (Administrator)



Joined: Apr 15, 2006
Member#: 14160
Posts: 25
Location: Bucharest, Romania

diginferno is offline View user's profile Send private message View diginferno's Favorites
Yahoo Messenger ICQ Number Visit MySpace
PostPosted: Sun Feb 10, 2013 5:36 pm   Post subject: Reply with quote


And who, pray tell, would tend to that "on-demand upload list" and sift through terabytes of tracks to make it happen? I trust that you realize that a human or twenty would be required to do it manually...
_________________
diginferno

.::If my answers frighten you then you should cease asking scary questions::.
Germany blablublaber
Cadet 4
Cadet 4



Joined: Sep 04, 2012
Member#: 33525
Posts: 16
Location: munich, english garden

blablublaber is offline View user's profile Send private message View blablublaber's Favorites
Skype Name
PostPosted: Sun Feb 10, 2013 7:47 pm   Post subject: Reply with quote


no human interaction required.

i am writing about a script running on sst and the other stations
(it would run on the 24/7 server and check periodically if all the tracks who are soon to be played (already in the Q) are there and the checksums fit to the backup.
if not it would upload the missing /damaged track

making checksums for a terabyte of files costs less than 24 hours so how long does it take to check them all?
Romania diginferno
Admiral (Administrator)
Admiral (Administrator)



Joined: Apr 15, 2006
Member#: 14160
Posts: 25
Location: Bucharest, Romania

diginferno is offline View user's profile Send private message View diginferno's Favorites
Yahoo Messenger ICQ Number Visit MySpace
PostPosted: Mon Feb 11, 2013 5:41 am   Post subject: Reply with quote


Script for Windows? I admit I am not that good.
_________________
diginferno

.::If my answers frighten you then you should cease asking scary questions::.
Germany blablublaber
Cadet 4
Cadet 4



Joined: Sep 04, 2012
Member#: 33525
Posts: 16
Location: munich, english garden

blablublaber is offline View user's profile Send private message View blablublaber's Favorites
Skype Name
PostPosted: Tue Feb 12, 2013 1:32 am   Post subject: Reply with quote


well we got php it works on linux and windows.
its not ideal but ok in this case since we need some binding to the database to get the current playlist
and then some function like "$hash=md5_file($filename)" can work on the problem on the server side.

i would prefer doing these things on linux too , but we can make do what we got.

having hashes of all the music files on the server and in the backup could save us a lot of time since only some 1/3 to 1/10 is broken/missing and needs fixing.

Code:
<?php
$hash=array();
foreach(get_current_playlist_filenames() as $filename){
$hash[]=md5_file($filename);
}
file_put_contents("server_hashes", implode('\n',$hash));

/** now compare to the ones from the backup and upload missing or wrong*/
?>
Romania diginferno
Admiral (Administrator)
Admiral (Administrator)



Joined: Apr 15, 2006
Member#: 14160
Posts: 25
Location: Bucharest, Romania

diginferno is offline View user's profile Send private message View diginferno's Favorites
Yahoo Messenger ICQ Number Visit MySpace
PostPosted: Tue Feb 12, 2013 3:13 pm   Post subject: Reply with quote


You got me there. I never considered using PHP CLI. Embarassed
_________________
diginferno

.::If my answers frighten you then you should cease asking scary questions::.
Display posts from previous:
Post new topic   Reply to topic    StreamingSoundtracks.com Forum Index -> Ideas All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



Forums ©


Copyright © 2001-2014 24seven.FM, LLC All rights reserved.
Comments, images, and trademarks are property of their respective owners.
You can syndicate our news using the file backend.php or ultramode.txt. Robots may follow the Sitemap.