From upstream https://github.com/get-got/discord-downloader-go.git
Modified for arm64
https://github.com/get-got/discord-downloader-go.git
|
2 years ago | |
---|---|---|
.gitattributes | 4 years ago | |
.gitignore | 2 years ago | |
.travis.yml | 2 years ago | |
Dockerfile | 2 years ago | |
Jenkinsfile | 2 years ago | |
LICENSE | 4 years ago | |
README.md | 2 years ago | |
commands.go | 2 years ago | |
common.go | 2 years ago | |
config.go | 2 years ago | |
database.go | 2 years ago | |
discord.go | 2 years ago | |
downloads.go | 2 years ago | |
go.mod | 2 years ago | |
handlers.go | 2 years ago | |
history.go | 2 years ago | |
main.go | 2 years ago | |
parse.go | 2 years ago | |
regex.go | 2 years ago | |
vars.go | 2 years ago |
Discord Downloader <i>Go</i>
<a href="https://travis-ci.com/get-got/discord-downloader-go" alt="Travis Build">
<img src="https://travis-ci.com/get-got/discord-downloader-go.svg?branch=master" />
</a>
<a href="https://hub.docker.com/r/getgot/discord-downloader-go" alt="Docker Build">
<img src="https://img.shields.io/docker/cloud/build/getgot/discord-downloader-go" />
</a>
<a href="https://goreportcard.com/report/github.com/get-got/discord-downloader-go" alt="Go Report Card">
<img src="https://goreportcard.com/badge/github.com/get-got/discord-downloader-go" />
</a>
<br>
<a href="https://github.com/get-got/discord-downloader-go/releases" alt="All Releases">
<img src="https://img.shields.io/github/downloads/get-got/discord-downloader-go/total?label=all-releases&logo=GitHub" />
</a>
<a href="https://hub.docker.com/r/getgot/discord-downloader-go" alt="Docker Pulls">
<img src="https://img.shields.io/docker/pulls/getgot/discord-downloader-go?label=docker-pulls&logo=Docker" />
</a>
<a href="https://github.com/get-got/discord-downloader-go/releases/latest" alt="Latest Release">
<img src="https://img.shields.io/github/downloads/get-got/discord-downloader-go/latest/total?label=latest-release&logo=GitHub" />
</a>
<br>
<a href="https://discord.gg/6Z6FJZVaDV">
<img src="https://img.shields.io/discord/780985109608005703?logo=discord"alt="Join the Discord">
</a>
<a href="https://discord.com/invite/6Z6FJZVaDV">
<b>Need help? Have suggestions? Join the Discord server!</b>
</a>
<br/><br/>
<a href="https://github.com/get-got/discord-downloader-go/releases/latest">
<b>DOWNLOAD LATEST RELEASE</b>
</a>
Operating System | Architectures ( ? = available but untested ) |
---|---|
Windows | amd64, arm64 (?), armv7/6/5 (?), 386 (?) |
Linux | amd64, arm64, armv7/6/5, risc-v64 (?), mips64/64le (?), s390x (?), 386 (?) |
Darwin (Mac) | amd64 (?), arm64 (?) |
FreeBSD | amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?) |
OpenBSD | amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?) |
NetBSD | amd64 (?), arm64 (?), armv7/6/5 (?), 386 (?) |
This project is a cross-platform cli single-file program to interact with a Discord Bot (genuine bot application or user account, limitations apply to both respectively) to locally download files posted from Discord in real-time as well as a full archive of old messages. It can download any directly sent Discord attachments or linked files and supports fetching highest possible quality files from specific sources (see list below). It also supports very extensive settings configurations and customization, applicable globally or per-server/category/channel/user. Tailor the bot to your exact needs and runtime environment. See the Features list below for the full list. See the List of Settings below for a settings breakdown. See Getting Started or anything else in the table of contents right under this to learn more!
<b>Originally a fork of <a href="https://github.com/Seklfreak/discord-image-downloader-go">Seklfreak's <i>discord-image-downloader-go</i></a></b>
The original project was abandoned, for a list of differences and why I made an independent project, <a href="#differences-from-seklfreaks-discord-image-downloader-go--why-i-made-this"><b>see below</b></a>
Read more in Discord Trust & Safety Team's Official Statement...
While this project works for user logins, I do not reccomend it as you risk account termination. If you can, use a proper Discord Bot user for this program.
NOTE: This only applies to real User Accounts, not Bot users. This program currently works for either.
Now that that's out of the way...
Commands are used as ddg <command> <?arguments?>
(unless you've changed the prefix)
Command | Arguments? | Description
--- | --- | ---
help
, commands
| No | Lists all commands.
ping
, test
| No | Pings the bot.
info
| No | Displays relevant Discord info.
status
| No | Shows the status of the bot.
stats
| No | Shows channel stats.
history
| SEE HISTORY SECTION | (BOT AND SERVER ADMINS ONLY) Processes history for old messages in channel.
exit
, kill
, reload
| No | (BOT ADMINS ONLY) Exits the bot (or restarts if using a keep-alive process manager).
emojis
| Optionally specify server IDs to download emojis from; separate by commas | (BOT ADMINS ONLY) Saves all emojis for channel.
Confused? Try looking at the step-by-step list.
Depending on your purpose for this program, there are various ways you can run it.
discord-downloader-go.exe settings2
or similar to run multiple instances sharing a database with separate settings files)/root/settings.json
/root/database
/root/
X:\My Folder
to /root/My Folder
You can either create a settings.json
following the examples & variables listed below, or have the program create a default file (if it is missing when you run the program, it will make one, and ask you if you want to enter in basic info for the new file).
"credentials"
section. (SEE BELOW)"admins"
list of the settings. (SEE BELOW)"adminChannels"
. (SEE BELOW)"channels"
section. (SEE BELOW)
"token"
setting. Remove the lines for "username"
and "password"
or leave blank (""
). To create a Bot User, go to discord.com/developers/applications and create a New Application
. Once created, go to Bot
and create. The token can be found on the Bot
page. To invite to your server(s), go to OAuth2
and check "bot"
, copy the url, paste into browser and follow prompts for adding to server(s)."username"
and "password"
settings. Remove the line for "token"
or leave blank (""
)."token"
setting. Remove the lines for "username"
and "password"
or leave blank (""
). Your account token can be found by opening the browser console / dev tools / inspect element
> Network
tab > filter for "library"
and reload the page if nothing appears. Assuming there is an item that looks like the below screenshot, click it and find "Authorization" within the "Request Headers" section
of the Headers tab. The random text is your token.Read Message
permissions in the server(s) of your designated channel(s).Send Message
permissions in the server(s) of your designated channel(s). If executing commands via an Admin Channel, the bot will only need Send Message
permissions for that channel, and that permission will not be required for the source channel.Read Message History
permissions in the server(s) of your designated channel(s).Bot
category, and ensure Message Content Intent
is enabled.Developer Mode
in Discord settings under Appearance
.Copy ID
.Copy ID
.Copy ID
.href="/channels/@me/CHANNEL_ID_HERE"
. Using this ID in place of a normal channel ID should work perfectly fine.I've been a user of Seklfreak's project since ~2018 and it's been great for my uses, but there were certain aspects I wanted to expand upon, one of those being customization of channel configuration, and other features like message reactions upon success, differently formatted statuses, etc. If some aspects are rudimentary or messy, please make a pull request, as this is my first project using Go and I've learned everything from observation & Stack Overflow.
This guide is to show you how to make the bot go through all old messages in a channel and catalog them as though they were being sent right now, in order to download them all.
If no channel IDs are specified, it will try and use the channel ID for the channel you're using the command in.
Argument / Flag | Details |
---|---|
channel ID(s) | One or more channel IDs, separated by commas if multiple. |
all |
Use all available registered channels. |
cancel or stop |
Stop downloading history for specified channel(s). |
list or status |
Output running history jobs in Discord & program. |
--since=YYYY-MM-DD |
Will process messages sent after this date. |
--since=message_id |
Will process messages sent after this message. |
--before=YYYY-MM-DD |
Will process messages sent before this date. |
--before=message_id |
Will process messages sent before this message. |
Order of arguments does not matter
ddg history
ddg history cancel
ddg history all
ddg history stop all
ddg history 000111000111000
ddg history 000111000111000, 000222000222000
ddg history 000111000111000,000222000222000,000333000333000
ddg history 000111000111000, 000333000333000 cancel
ddg history 000111000111000 --before=000555000555000
ddg history 000111000111000 --since=2020-01-02
ddg history 000111000111000 --since=2020-10-12 --before=2021-05-06
ddg history 000111000111000 --since=000555000555000 --before=2021-05-06
ddg history status
ddg history list
I tried to make the configuration as user friendly as possible, though you still need to follow proper JSON syntax (watch those commas). Most settings are optional and will use default values or be unused if missing from your settings file.
When initially launching the bot it will create a default settings file if you do not create your own settings.json
manually. All JSON settings follow camelCase format.
If you have a config.ini
from Seklfreak's discord-image-downloader-go, it will import settings if it's in the same folder as the program.
The bot accepts .json
or .jsonc
for comment-friendly json.
DO NOT LEAVE COMMAS ,
AFTER THE LAST ITEM IN A SECTION. JSON DOES NOT LIKE THIS, IT WILL ERROR.
{
"credentials": {
"token": "YOUR_USER_OR_BOT_TOKEN", // user with 2FA or genuine Discord bot.
"email": "YOUR_USER_EMAIL_NO_2FA", // user without 2FA.
"password": "YOUR_USER_PASSWORD_NO_2FA", // user without 2FA.
"twitterUsername": "", // Twitter Account, not required but can be used for scraping private accounts.
"twitterPassword": "", // Twitter Account, not required but can be used for scraping private accounts.
"instagramUsername": "", // Instagram Account, captcha required at some point(s).
"instagramPassword": "", // Instagram Account, captcha required at some point(s).
"flickrApiKey": ""
},
"admins": [
"YOUR_DISCORD_USER_ID",
"YOUR_FRIENDS_DISCORD_USER_ID",
"YOUR_OTHER_FRIENDS_DISCORD_USER_ID"
],
"adminChannels": [
{
"channel": "DISCORD_CHANNEL_ID_FOR_COMMANDS",
"logProgram": false, // output most program logging to channel (this is typically a lot)
"logStatus": true, // output program status updates to channel
"logErrors": true, // output download errors to channel
"unlockCommands": false // allow non-admins to use commands in this channel
}
],
"processLimit": 32, // # of concurrent tasks allowed at once.
"debug": false, // detailed program info.
"backupDatabaseOnStart": false, // backup database folder to dated zip file in local "backups" folder.
"watchSettings": true, // update settings live if file is modified.
"settingsOutput": true, // display parsed settings on load.
"messageOutput": true, // display messages being processed in real time.
"messageOutputHistory": false, // display messages being processed while running history.
"discordLogLevel": 0, // discord API log leveling setting.
"discordTimeout": 180, // seconds to wait before giving up on a stale Discord connection.
"downloadTimeout": 60, // seconds to wait before giving up on a download.
"downloadRetryMax": 3, // times to retry a failed download.
"exitOnBadConnection": false, // kill the program when encountering a faulty Discord connection rather than retrying.
"githubUpdateChecking": true, // check for program updates on launch.
"commandPrefix": "ddg ", // prefix for discord commands.
"scanOwnMessages": false, // checks messages of authenticated user, should be false if genuine bot, true if selfbot.
"allowGeneralCommands": true, // ping/help/info/etc.
"inflateDownloadCount": 0, // +/- displayed download tally.
"europeanNumbers": false, // 1.000.000,00 (disgusting) versus 1,000,000.00 (normal).
"checkupRate": 30, // minutes to print checkup line in program.
"connectionCheckRate": 5, // minutes to check Discord connection for failure.
"presenceRefreshRate": 3, // minutes to refresh Discord presence, sometimes it randomly goes blank.
"save": true,
"allowCommands": true,
"scanEdits": true,
"ignoreBots": true,
"sendErrorMessages": false,
"sendFileToChannel": "", // Forward detected media to channel.
"sendFileToChannels": [ "" ], // ^.
"sendFileDirectly": true, // Send direct file as attachment or embed in message.
"sendFileCaption": "", // Caption to accompany media.
"filenameDateFormat": "2006-01-02_15-04-05", // Format for {{date}}.
"filenameFormat": "{{date}} {{file}}",
"presenceEnabled": true,
"presenceStatus": "idle", // "online" or "idle" or "dnd" or "invisible".
"presenceType": 0, // 0 = Playing, 1 = Streaming, 2 = Listening, 3 = Watching.
"presenceLabel": "{{timeSavedShort}} - {{countShort}} files",
"presenceDetails": "{{timeSavedLong}}", // user accounts only.
"presenceDetails": "{{count}} files total", // user accounts only.
"reactWhenDownloaded": false, // react to messages downloaded from.
"reactWhenDownloadedEmoji": "", // specify emoji for reactions, random otherwise.
"reactWhenDownloadedHistory": false, // react to messages downloaded from in history jobs.
"historyTyping": true, // show user as typing when processing history.
"embedColor": "", // override embed color, role color by default.
"historyMaxJobs": 3, // # of history jobs allowed to run concurrently, constrained by processLimit above.
"autoHistory": false, // automatically run history on launch.
"autoHistoryBefore": "", // YYYY-MM-DD for date filtering.
"autoHistorySince": "", // YYYY-MM-DD for date filtering.
"sendAutoHistoryStatus": false, // send status message for auto history jobs.
"sendHistoryStatus": true, // send status message for history jobs.
"divideByYear": false,
"divideByMonth": false,
"divideByServer": false,
"divideByChannel": false,
"divideByUser": false,
"divideByType": true, // images/videos/audio/text/other.
"divideFoldersUseID": false, // use Discord IDs rather than user/server/channel names.
"saveImages": true,
"saveVideos": true,
"saveAudioFiles": true,
"saveTextFiles": false,
"saveOtherFiles": false,
"savePossibleDuplicates": true, // save if exact filename already exists.
"filters": {
// when "allowed" options are enabled, nothing is allowed unless it meets their criteria.
"blockedPhrases": [ "" ],
"allowedPhrases": [ "" ],
"blockedUsers": [ "" ], // by Discord ID.
"allowedUsers": [ "" ], // by Discord ID.
"blockedRoles": [ "" ], // by Discord ID.
"allowedRoles": [ "" ], // by Discord ID.
"blockedDomains": [ "" ],
"allowedDomains": [ "" ],
"blockedExtensions": [ ".htm", ".html", ".php", ".exe", ".dll", ".bin", ".cmd", ".sh", ".py", ".jar" ],
"allowedExtensions": [ "" ],
"blockedFilenames": [ "" ], // List of phrases to check for in original filename, pre-formatting.
"allowedFilenames": [ "" ],
"blockedReactions": [ "" ], // List of reactions to block or allow, by ID only.
"allowedReactions": [ "" ]
},
// duplicate image filtering
// caching of image data is stored via a database file; it will not read all pre-existing images.
"duplo": false,
// threshold for what the bot considers too similar of an image comparison score.
// * lower = more similar (lowest is around -109.7).
// * higher = less similar (does not really have a maximum, would require your own testing).
// if score is lower than your threshold, the image will be skipped.
"duploThreshold": 0,
"all": {
"destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
},
"allBlacklistUsers": [ "" ],
"allBlacklistServers": [ "" ],
"allBlacklistCategories": [ "" ],
"allBlacklistChannels": [ "" ],
"users": [
{
"user": "SOURCE_DISCORD_USER_ID",
"users": [ "SOURCE_DISCORD_USER_ID" ],
"destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
}
],
"servers": [
{
"server": "SOURCE_DISCORD_SERVER_ID",
"servers": [ "SOURCE_DISCORD_SERVER_ID" ],
"serverBlacklist": [ "DISCORD_CHANNELS_TO_BLOCK" ],
"destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
}
],
"categories": [
{
"category": "SOURCE_DISCORD_CATEGORY_ID",
"categories": [ "SOURCE_DISCORD_CATEGORY_ID" ],
"categoryBlacklist": [ "DISCORD_CHANNELS_TO_BLOCK" ],
"destination": "FOLLOW_CHANNELS_BELOW_FOR_REST"
}
],
"channels": [
{
"channel": "SOURCE_DISCORD_CHANNEL_ID",
"channels": [ "SOURCE_DISCORD_CHANNEL_ID" ],
"destination": "files/example-folder",
"enabled": true,
"save": true,
"allowCommands": true,
"scanEdits": true,
"ignoreBots": true,
"sendErrorMessages": false,
"sendFileToChannel": "",
"sendFileToChannels": [ "" ],
"sendFileDirectly": true,
"sendFileCaption": "",
"filenameDateFormat": "2006-01-02_15-04-05",
"filenameFormat": "{{date}} {{file}}",
"presenceEnabled": true,
"reactWhenDownloaded": false,
"reactWhenDownloadedEmoji": "",
"reactWhenDownloadedHistory": false,
"blacklistReactEmojis": [ "" ],
"historyTyping": true,
"embedColor": "",
"autoHistory": false,
"autoHistoryBefore": "",
"autoHistorySince": "",
"sendAutoHistoryStatus": false,
"sendHistoryStatus": true,
"divideByYear": false,
"divideByMonth": false,
"divideByServer": false,
"divideByChannel": false,
"divideByUser": false,
"divideByType": true,
"divideFoldersUseID": false,
"saveImages": true,
"saveVideos": true,
"saveAudioFiles": true,
"saveTextFiles": false,
"saveOtherFiles": false,
"savePossibleDuplicates": true,
"filters": {
"blockedPhrases": [ "" ],
"allowedPhrases": [ "" ],
"blockedUsers": [ "" ],
"allowedUsers": [ "" ],
"blockedRoles": [ "" ],
"allowedRoles": [ "" ],
"blockedExtensions": [ ".htm", ".html", ".php", ".exe", ".dll", ".bin", ".cmd", ".sh", ".py", ".jar" ],
"allowedExtensions": [ "" ],
"blockedDomains": [ "" ],
"allowedDomains": [ "" ]
},
"duplo": false,
"duploThreshold": 0,
"logLinks": {
"destination": "",
"destinationIsFolder": false,
"divideLogsByServer": true,
"divideLogsByChannel": true,
"divideLogsByUser": false,
"divideLogsByStatus": false,
"logDownloads": true,
"logFailures": true,
"filterDuplicates": false,
"prefix": "",
"suffix": "",
"userData": false
},
"logMessages": {
"destination": "",
"destinationIsFolder": false,
"divideLogsByServer": true,
"divideLogsByChannel": true,
"divideLogsByUser": false,
"filterDuplicates": false,
"prefix": "",
"suffix": "",
"userData": false
}
}
]
}
{
"credentials": {
"token": "YOUR_USER_OR_BOT_TOKEN",
"email": "YOUR_USER_EMAIL_NO_2FA",
"password": "YOUR_USER_PASSWORD_NO_2FA"
},
"admins": [ "YOUR_DISCORD_USER_ID" ],
"adminChannels": [{ "channel": "DISCORD_CHANNEL_ID_FOR_COMMANDS" }],
"channels": [
{
"channel": "SOURCE_DISCORD_CHANNEL_ID",
"destination": "files/example-folder"
}
]
}
{
"credentials": {
"token": "YOUR_USER_OR_BOT_TOKEN",
"email": "YOUR_USER_EMAIL_NO_2FA",
"password": "YOUR_USER_PASSWORD_NO_2FA"
},
"admins": [ "YOUR_DISCORD_USER_ID" ],
"adminChannels": [{ "channel": "DISCORD_CHANNEL_ID_FOR_COMMANDS" }],
"save": true,
"allowCommands": true,
"scanEdits": true,
"ignoreBots": false,
"sendErrorMessages": true,
"presenceEnabled": true,
"presenceStatus": "idle",
"presenceType": 0,
"presenceLabel": "{{timeSavedShort}} - {{countShort}} files",
"presenceDetails": "{{timeSavedLong}}",
"presenceDetails": "{{count}} files total",
"reactWhenDownloaded": true,
"reactWhenDownloadedHistory": true,
"historyTyping": true,
"channels": [
{
"channel": "SOURCE_DISCORD_CHANNEL_ID",
"destination": "files/example-folder"
}
]
}
{
"credentials": {
"token": "YOUR_USER_OR_BOT_TOKEN",
"email": "YOUR_USER_EMAIL_NO_2FA",
"password": "YOUR_USER_PASSWORD_NO_2FA"
},
"admins": [ "YOUR_DISCORD_USER_ID" ],
"adminChannels": [{ "channel": "DISCORD_CHANNEL_ID_FOR_COMMANDS" }],
"save": true,
"allowCommands": false, // they'll probably kick you otherwise.
"scanEdits": true,
"ignoreBots": false,
"sendErrorMessages": false, // they'll probably kick you otherwise.
"presenceEnabled": false, // they'll probably kick you otherwise.
"presenceStatus": "invisible", // or "dnd" or "idle"
"reactWhenDownloaded": false, // they'll probably kick you otherwise.
"reactWhenDownloadedHistory": false, // they'll probably kick you otherwise.
"historyTyping": false, // they'll probably kick you otherwise.
"channels": [
{
"channel": "SOURCE_DISCORD_CHANNEL_ID",
"destination": "files/example-folder"
}
]
}
[MAJOR].[MINOR].[PATCH]
https://semver.org/