Jump to content

Avatar

Is there an easier way/bulk method to download all customs uploaded to this site for my NAS storage?


  • Please log in to reply
11 replies to this topic

#1 cleverest

cleverest
  • 152 posts

Posted July 20, 2020 - 01:55 AM

I just have to ask at this point, as I'm only up to Song Titles alphabetically just beyond > BOY

...I was wondering if it's possible to download every song (filtered by ones that have drum part if possible, but if not, that's okay) on this website all at once or in larger download packs vs. 1 by 1?

I'm building a large NAS next month and would love to store/preserve all of this hard work (Not only my own, since I'm starting to build them) and I would do an update cycle every month at least to grab new & updated songs as they are submitted. I would share this NAS share with the admins as well and anyone else they trusted/vetted.

It's taking forever downloading the tracks individually, or maybe I'm missing a faster batch method that works well?



#2 Spindoctor

Spindoctor
  • 1,317 posts
  • Location
    British Columbia Canada

Posted July 20, 2020 - 02:09 AM

...I was wondering if it's possible to download every song (filtered by ones that have drum part if possible, but if not, that's okay) on this website all at once or in larger download packs vs. 1 by 1?
 

Nope, one at a time from this database


Links to all songs are in the Customs database.

 

Rock with the Doc at c3Universe

 

"Music can change the world because it can change people"  

Bono


#3 MrPrezident

MrPrezident

    C3U Moderator

  • 1,107 posts
  • Location
    Nanaimo, BC, Canada

Posted July 20, 2020 - 02:52 AM

I would rather you take the time to read about each of the songs I've worked on, and possibly say thanks for the effort, rather than you just download all 300+ of them and never come back.   Just my take.


FORUM THREAD  /  MY CUSTOMS -  featuring all the best animal customs:  A Flock of Seagulls, Eagles of Death Metal, Sheepdogs, Turtles, Mouse Rat and Wolfmother.   


#4 jerrylive365

jerrylive365
  • 156 posts
  • Location
    California

Posted July 20, 2020 - 04:16 AM

I would rather you take the time to read about each of the songs I've worked on, and possibly say thanks for the effort, rather than you just download all 300+ of them and never come back.   Just my take.

 

Can I get an Amen, brothers!!???



#5 cleverest

cleverest
  • 152 posts

Posted July 20, 2020 - 05:32 AM

I would rather you take the time to read about each of the songs I've worked on, and possibly say thanks for the effort, rather than you just download all 300+ of them and never come back.   Just my take.

I understand.

I would hope people do the same for my tracks whenever I upload them, but to be clear, I have done exactly that for many of the songs (and to be fair, many have no text/descriptions) and I've clicked LIKE for a lot of those up to my daily capacity often for downloaded songs; I just dread having to click my mouse 4 times per song to download them, which will be like a total of at least 80,000 clicks to get them all, assuming 20k songs in the database (I have no idea, but given I have just over 1,700 and I'm still in B's for song title (filtered by showing only ones with expert drums)..it's a lot...

I know the Xbox 360/RB3 can only hold 2,964 games or whatever at a time, but that's what multiple flash drives and a NAS are for; I can swap out full sets easier that way...and again it's not only to play them. (which I probably can't do in this lifetime!), but to preserve them as well.

I guess I was just wondering if anyone knew an obvious method I was failing to grasp,  and somehow it meant I was just stupidly trudging slowly and getting them 1 by 1; if not I'll soldier on like everyone else.



#6 NotRocker1999

NotRocker1999
  • 14 posts
  • Location
    NOT Orlando, FL

Posted July 20, 2020 - 05:57 AM

I would rather you take the time to read about each of the songs I've worked on, and possibly say thanks for the effort, rather than you just download all 300+ of them and never come back.   Just my take.


I mean this might just be the case for me, but I would actually like to bulk download since I want to one day find the song limit for RB2 and RB4, if there is one. Downloading the songs one by one is what really holds me back from finding out if there really is a limit.

#7 AJFOne23

AJFOne23
  • 2,269 posts
  • Location
    Hell on Earth

Posted July 20, 2020 - 06:01 AM

I would rather you take the time to read about each of the songs I've worked on, and possibly say thanks for the effort, rather than you just download all 300+ of them and never come back.   Just my take.

 

55850639.jpg



#8 cleverest

cleverest
  • 152 posts

Posted July 20, 2020 - 06:18 AM

I mean this might just be the case for me, but I would actually like to bulk download since I want to one day find the song limit for RB2 and RB4, if there is one. Downloading the songs one by one is what really holds me back from finding out if there really is a limit.

2,964 I believe is the limit, but I agree. I don't automatically like everything I download, unless I know what the song IS, and really like the song already, and also assuming the person did a decent job with it (it's not a total mess, which I don't know unless I try it), OR if I don't know if I like it, I'll come back later and comment/like it, etc.



#9 NotRocker1999

NotRocker1999
  • 14 posts
  • Location
    NOT Orlando, FL

Posted July 20, 2020 - 07:28 AM

2,964 I believe is the limit, but I agree. I don't automatically like everything I download, unless I know what the song IS, and really like the song already, and also assuming the person did a decent job with it (it's not a total mess, which I don't know unless I try it), OR if I don't know if I like it, I'll come back later and comment/like it, etc.

No, not RB3's song limit, which is well known.  I'm talking about Rock Band 2 and 4, which does not have a known limit, if any. 

 

More on this though, trying to download every song, and then convert it to the proper game really does take a lot of time and effort, and being able to cut time on one end would be really good.  Converting isn't really an issue for RB2 since you can batch convert, but it's a lot more difficult for RB4 since the tools do not allow for batch conversion in an easy manner.



#10 Farottone

Farottone

    The Lean Mean Customs Charting Machine

  • Administrator
  • 6,475 posts

Posted July 20, 2020 - 11:32 AM

First, technically we don't have the resources to let people bulk download the database. A full dump of this database is roughly 300GB, thousands of bulk downloads per month mean hundres of TBs of data out.

 

Second, again technically, we couldn't let you bulk download the DB because you'd be missing all the files hosted on external sites like Mediafire, for which you would need something like JDownloader.

 

Third, our tracking system doesn't work for bulk, which means we would need to update the code or lose all stats for bulk downloads.

 

Finally, I don't dislike that people only download what they really want: if a song you pay 0 money for isn't even worth the 2 clicks (2 because Google isn't happy with redirects, otherwise it would be 1) needed to go from the DB page to having it on your hard drive, maybe you didn't really want the content in the first place. Since we pay by GB downloaded, I don't mind saving a few bucks for content that wouldn't have been played anyway



#11 Farottone

Farottone

    The Lean Mean Customs Charting Machine

  • Administrator
  • 6,475 posts

Posted July 20, 2020 - 01:56 PM

I just have to ask at this point, as I'm only up to Song Titles alphabetically just beyond > BOY

...I was wondering if it's possible to download every song (filtered by ones that have drum part if possible, but if not, that's okay) on this website all at once or in larger download packs vs. 1 by 1?

I'm building a large NAS next month and would love to store/preserve all of this hard work (Not only my own, since I'm starting to build them) and I would do an update cycle every month at least to grab new & updated songs as they are submitted. I would share this NAS share with the admins as well and anyone else they trusted/vetted.

It's taking forever downloading the tracks individually, or maybe I'm missing a faster batch method that works well?

 

We'd rather not you shared this publicly. You can absolutely set up your own server for your needs of course, but please don't re-share our customs because you're taking away precious stats from our authors
 



#12 cleverest

cleverest
  • 152 posts

Posted July 20, 2020 - 03:30 PM

 

We'd rather not you shared this publicly. You can absolutely set up your own server for your needs of course, but please don't re-share our customs because you're taking away precious stats from our authors
 

 

I want to be clear. I've never offered to share this publicly (and would not); I only offered to share it to Admins and trusted (by the Admin) users only.

But as per your other post, if there is no value in having this stuff backed up to a NAS and updated monthly, while being shared to admins and trusted people only (or you just don't believe me), then no worries, I won't offer it again.  I also planned to have packs sorted by Artists and updated accordingly. I'll just keep that all to myself. :-)

Thanks for the response.






1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users