Talk:XChan Directory Dumper
From Encyclopedia Dramatica
Contents |
GNU/Linux
Hi, I am running this in GNU/Linux; it does not seem to work correctly. When a file already exists, it still says "done!", and when a file doesn't exist (aka it should post fine), it says DONE, but it doesn't post ;_; Hy71194 13:43, 6 November 2009 (UTC)
- I think the problem lies in the first sentence -- this is a Windows program. but seriously, Wine doesn't admit to be fully compatible with all programs, and I can't really debug the app for a broken compatibility layer, so I have no solutions for you (other than use windows). for the record the dumper posts "done!" whenever there's an error because it doesn't do error checking; that will change next release --GeneRayburn 21:39, 10 November 2009 (UTC)
Image Spammer Sauce?
Anyone have the sauce for xchan image spammer? or saviorchan --F00thePirate 03:25, 18 October 2009 (UTC)
- I do, unsurprisingly enough. not giving it out tho (but it was in java... just decompile it) --GeneRayburn 21:19, 27 October 2009 (UTC)
Need web space?
Probably not, but I thought I'd offer it just for shits and giggles. Lordhelpus 05:35, 9 May 2009 (UTC)
- me? nah, but I appreciate the offer. in fact I already have a $2/month hosting account already but I don't even use it (original use died out), so w.e. thanks tho --GeneRayburn 14:18, 10 May 2009 (UTC)
New Suggestions?
I really like this. I do not know of the author is still active. Anyways, it would be cool option to be able to maybe do #op# into the comment field to have it quote OP's post? Also, maybe a system to check if the image upload failed (spam filter? blacklisted image?) and then if it is a blacklisted image, it will somehow edit it so it just edits 1 pixel (so it will change the MD5 hash), then re-post. It it was spam filtered, have the program edit the comment with a random number string? Thanks for reading and making a great program. --Hy71194 21:07, 13 April 2009 (UTC)
Also, the "name" field will not work on 4chan. --Hy71194 22:52, 13 April 2009 (UTC)
- sup. couple points:
- a) are you saying #op# should just quote the thread number (>>1234141) or a text quote (>I'm quoting the op). if you're talking about the latter then I doubt I will do that (it requires the client getting the thread page first, which isn't hard to do but so far the bot doesn't do any 'downloading' of internet contents)
- b) if you want a spamming program, search for the xchan image spammer, which in fact uses that exact 1-px technology to get around the hash check. as for blacklisted images, what boards have blacklisted images? I've never heard of that
- c) the whole text-spam-filter thing could already be gotten around by using the #times# variable, since that'll change each time
- --GeneRayburn 21:19, 21 April 2009 (UTC)
- You didn't answer about the name field. I've been trying with XDDAddNewFormElement and XDDChangeFormElement to get it to work that way, but can't seem to be able to. May you share an example of how to do it, or simply a way to enter your own headers?
- Please note, I've not been using this for /b/, but other boards on 4chan.
- --Shhac 20:24, 5 May 2009 (UTC)
- yeah, that was me being an idiot; I will fix the name field thing (this is what happens when you don't update code for two years). as for AddNew/Change, there was a bug in the initial version of v3 in which custom fields were ignored. could you try downloading the latest version and then trying again? (pretty sure I fixed that bug somewhere along the revision of v3) also confirm that the script is being executed (e.g. at the very end add a XDDPrintln(), if your output appears then you know the code executed)
- --GeneRayburn 14:02, 10 May 2009 (UTC)
- If you haven't changed it in the last 5 days then I can make the script execute on start-up with XDDPrintln() if it is saved in ANSI, but addnew/change seem to have no effect, which is why I asked about custom headers. If you're going to fix the name thing, can I suggest you add a new function like "UpdateField(fieldName, newFieldName, boardType)" e.g. of use: UpdateField("file","up_file","4chan"). The compatibility wouldn't break if the user could redefine all of those variables if they've been changed since the last edition of your application.
- --Shhac 15:35, 10 May 2009 (UTC)
- I will see what's up. as I said I added the addnew/change feature without having the ability to check it at the time; now I have a webserver that I can check it against. my dev computer is in for repairs atm so I apologise for the delay in fixing stuff, but I will get to it.
- as for the updatefield idea, that's somewhat similar to a xddv3.5 or a xddv4 idea I had, which was to convert board configurations into files as opposed to being hardcoded like they are now. essentially the file format would consist of specific hard-coded elements referring to GUI inputs (e.g. #file#, #username#, #comment#) and the file would then define what that element should be called on upload. for example, the 4chan comment field is named "com" in the html files, so this board configuration file would have a line including "com=#comment#" or for the file input, "upfile=#file#". this method would allow you to quickly change element names and add new elements in a nicer way than addnew/change. that isn't to say I'll get rid of addnew/change, this is just another way of going about things. --GeneRayburn 16:53, 13 May 2009 (UTC)
- Finally got my comp back, revision 3 uploaded. fixes 4chan name issue & also fixes AddNew/ChangeFormElement functions. --GeneRayburn 23:28, 31 May 2009 (UTC)
- Awesome :) Works fine. Much thanks. It would be nice to have a "pause posting" option though. So you can pause it with a button, then resume with the same button. --Hy71194 17:45, 1 June 2009 (UTC)
You know what'd be great? A "delete after posting" option. Often, someone fucks around on my computer, and I have to restart the process again a month later after the thread 404s, if the program deleted the images immediately after posting them, I wouldn't have this problem. Also, some kind of a renaming option would be fan-fucking-tastic. Instead of "6473494759474.jpg", I would like if the program renamed the files, then uploaded them so it would be something like "Family_Play_Chapter_1 page_1.jpg" or something off the sort. just a few ideas, maybe they'll springboard onto something better. Thanks. Dimatodd 23:20, 18 August 2009 (UTC)
- Addendum: Also, it would be great if the program at least logged everything and spit out a .txt file, so that you can have a list of which pictures were posted, and what went wrong where (if anything SHOULD go wrong, I mean).Dimatodd 23:03, 19 August 2009 (UTC)
- a) hold on, what? I'm not getting the delete after posting idea, nor the problem it solves. are you saying you have dumps that last a month long?
- b) why didn't you rename em when downloading em in the first place? again I'm not seeing the point insofar as the message board will change the filename to 1298321983902189894.jpg anyway
- c) maybe, I mean I really should implement a check for failed uploads, currently though the code is intentionally disregarding the HTTP response.
- --GeneRayburn 06:09, 27 August 2009 (UTC)
- a) I sometimes dump my /wp/ directory, which has upwards of 5k pictures. Every now and again, things go wrong and I have to restart from the very beginning, and the pictures aren't posted twice, they're just not posted again, so all this is wasted time. Also, considering the weird ordering of the dumper, pictures from all over the folder are dumped in a weird order which Windows cannot sort by. In short, wasted time. I create another folder, copy all the pictures into it, and as the program dumps, it deletes. This way, I can just pick up where I left off.
- b) I didn't rename them because I was lazy, and now there's over 500 of them. I'm not renaming all of them, fuck that! It'll take me days, weeks, months even!!!! While it would take the program a few minutes maybe.
- c) That would be fantabulous, thank you.
- a) I understand what you're saying now. Related to c), I've started work on v3.2 which will indeed start checking for errors, and in the case of an error, the thing will try to reupload the file (if it makes sense -- if the error is a flooding error, the thing will try again, but if the error is a duplicate file error, it would be stupid to keep trying and trying and trying...). Additionally you would be well advised to download v3.1 which now sorts files alphabetically exactly as Windows does.
- Finally for b), I still don't understand how the program can help you here. The most you can expect is a program that would rename all the files with some common root name (e.g the folder name or whatever) and then append some number like "_001", "_002", etc. Fine, so assume that's what it does. But how does it know it's renaming in the correct order? For example, if you have two files named 1239184.jpg and 5898132.jpg, then the program would rename them "file_001.jpg" and "file_002.jpg" because that's how they are alphabetically ordered. However, there's a massive chance that logically (i.e. given how the manga goes), it should be the other way around -- given that the filenames the boards generate are completely random with no order, it's impossible to know. So then you would have to have some way of telling the program which one should be called which, but then you still end up having to go through each file manually, and by then you might as well just be renaming them all by hand anyway. --GeneRayburn 00:40, 12 September 2009 (UTC)
Finally
Someone makes a new version. v2a was utter shit (I know because I helped make it) and only added the ability to send a useragent header. Also good to see someone made a new GUI, seeing as we weren't able to get the source to it. Now for the spammer... --Hazim 08:52, 13 February 2009 (UTC)
- Didn't you read the damn readme, I said I ain't redoing image spammer, moot/coda hate me enough already. Decompile the java class already if you need to make changes; you obviously already know how. --GeneRayburn 17:35, 13 February 2009 (UTC)
Sauce?
Anyone have the sauce coed? -- Nexis ( Scream · Contribs) 18:23, 1 January 2008 (CST)
EXPERT PROGRAMMERS ITT
Okay, I'm a mere BBCODE PROGRAMMER, but I want to increase the functionality of my xChan Directory Dumper v3. My diabolical plan is to modify the comment text of each post by a random character to prevent spam-blocking on the board I want to post to from blocking my posts. Understandably, this is a pain to do manually for 50 images. How do I edited comment text?Not an expert programmer 19:33, 23 November 2008 (CST)
- You can't edit the comment text via a script (i.e. not with xddscript.xcpp). However, if you just need to avoid a spam filter, you could enter the #times# tag into the Comment field, and the program will automatically replace this with the number of uploads made (check Classic mode instructions, Step 3 for more deats). --GeneRayburn 20:10, 29 November 2008 (CST)
File Ordering
First, thanks for taking the time to create v3 - it promises to be an awesome prog. I have carefully read all the HTM files you included for help, and noticed that you like the way wxWidgets orders files in a dir for posting [ (len($filename)) before alphabetically ]. I recently wanted to use v3 to tell a story with pix and text, but v3 wanted to post 03 - map.jpg then 07 - alps.jpg then 25 - candy.jpg etc. I tried to use the GUI to re-order the posts, but could not make it happen, so I opened the settings file I saved in a text editor, and re-organized them there. It was a hassle , and when I tried to dump my load, the logger said it was successful, but the posts did not appear on the chan site. I can only assume that I messed something up in the .XDD file.
In conclusion, I would like to suggest that a way be made to force a change in post order through the GUI.
Thanks for your time, -Cache
- All I can say is, I can't see a way to implement your particular file ordering without a monstrosity of an algorithm I don't care to come up with. As for the copy and paste reordering, that should have worked. The only thing I could suggest is check every detail between a generated XDD file and your custom XDD file. --GeneRayburn 16:26, 7 January 2009 (CST)
Might Want to Remove
The "h4x3d" version is infected with two trojans. Scanned it myself. I don't know if this was the intention to troll people but yeah. It's there. JustSomeLurker 14:26, 30 July 2009 (UTC)
- people should be dl'ing v3 anyhow, so no biggie --GeneRayburn 03:38, 3 August 2009 (UTC)
xChan Directory Dumper is awesome. Thank you. :-D
As far as a feature request, how about displaying the thread # somewhere on the uploading screen, in case I accidentally close the browser... again..., I'd be able to get back to my thread. :-)
Also, anyone wanting *rename* features, check out "1-4a Rename", it's a good renaming program.
- sure, what the heck. that's what I like to do, feature requests which take no effort at all --GeneRayburn 03:14, 30 September 2009 (UTC)
How about you releasing the code? If you dont want every BBCode Expert out there to get their hands on it, you could email me at Im@ugleh.com, I want to add a random char at the ending for each post. Or create a way so members can put in the message {RandomChar}, being the random number.
- umm, nah. what's wrong with #times#? --GeneRayburn 03:22, 26 October 2009 (UTC)
Multi-file upload support
I don't know if you noticed, but I added multi-file upload (ala anonib and ib4f) to the next (yet to be released) version of Kusaba, it's already activated at 7chan and unlikely to change from its current state (ie, the input name for files has been renamed to "imagefile[]" as opposed to "imagefile", but both work for backwards compatibility with the old dumper versions). You may want to start adding some preliminary support for this. If you need anything for me to put in Kusaba to make this easier to put in the dumper, or any questions, let me know, either here or on #7chan --Sazpaimon 12:28, 23 October 2009 (UTC)
- I did notice this, but I doubt there'll be anything I need you to do though. but, you're the guy behind kusaba? what I could use from you is a list of the error messages which can be returned on post upload (e.g. "error: duplicate file" etc). error handling is the next big thing for v3.2, and while I have it working fine for 4chan, I've noticed kusaba seems to have more variable error messages (they don't all start with "error:"?) so it's harder to parse. if you can give me a list then I can have the program look for and recognize those messages. for those who only wanna know when the next version is coming out, well 3.2 is mostly done, I'm just so insanely busy/lazy that I haven't packaged it up yet. expect it some time around december (maybe including the multi-file feature). --GeneRayburn 03:22, 26 October 2009 (UTC)
- Yeah, I'm one of the main developers of Kusaba X. Most of the errors thrown during an upload can be found on the upload.class.php file, you can find the latest source here, surrounded by the "exitWithErrorPage" function, however, you'd probably be better off grabbing the HTML from the error message page, as the actual error message text can change on different versions of the software. In fact, 1.0 is getting a major rewrite and a name change, so many error codes may change at any given time. The template we use for this page can be found here. The bit you need to worry about is the stuff surrounding "{$errormsg}" (which gets replaced with the actual error message). {$errormsgext} rarely gets used so you won't need to worry about it. --Sazpaimon 05:15, 27 October 2009 (UTC)
