Some tips on downloading and uploading DCPs and large files

Here are some tips on downloading and uploading DCPs and other large files like prores quicktime files:


Downloading

-I recommended using a fast wired internet connection. (20/20-50/50 mbit/s). (Use a good network cable/router)
-I recommend using a download manager like Free download manager  (Windows/mac) that support resume and multi-part downloading. Free Download will allocate disk space in the start of the transfer and then the download speed will increase.

Uploading
-I recommended using a fast wired internet connection. (20/20-50/50 mbit/s). (Use a good network cable/router)
-I recommend a reboot of the computer or at least a restart of chrome before uploading large files (100 GB) in a web uploader.

Filemail

I have used filemail to receive files on many film festivals I have worked on.

-On filemail.com you can send 30 GB files for free. With a Filemail Pro or Business account you can send and receive 100-200 GB files.

-I have used the filemail html5 uploader on many 100 gb files. You can also use the html5 uploader to send folders. The Desktop filemail app also works well on 100 gb files and can be used to auto download all incoming files.

-With a Filemail business account you will have access to the files for longer and people can use a branded upload web page. You can also enable the md5 hash value. Filemail now has an option for permanent storage.

Filemail md5 hash check

Filemail shows the md5 checksum on the download page if you enable it in the settings for the business download page.

 

This way you can check if the uploaded file is correct if the client sends you the original md5 checksum. You can ask for the md5 checksum as info on the upload page. This way you and the client can verify that the file is correct.

Generating a MD5 checksum
The client can find the MD5 checksum of a file with utilities like Hash Tab for windows and Hash Tab for mac

You also use the command md5 "file" in a terminal on a Mac to generate a md5 file hash value. The Terminal app is in Applications – Utilities. You can type md5 and push space, then drag the file from a finder window and push enter.

You can use the command certutil -hashfile "file" md5 on a Windows 7, 8, 10 computer in a command prompt (CMD)

You can use md5sum "file" in a terminal on a linux computer.

Verification
-If the sender sends a 7z archive, the receiver will know when unpacking if the file fails the 7z checksum test.
-When sending prores quicktime files it is important that the sender include a md5 checksum to enable verification of the file.
-DCPs have the checksums in the XML files that can be verified with easydcp player or using this command
openssl sha1 -binary "FILE_NAME" | openssl base64 

7z archives
-If you want to send a uncompressed quicktime file, TIFF or DPX image sequences or wav files I suggest using 7z with normal compression. A uncompressed quicktime file will be reduced to half the size after 7z compression.
-I recommend Keka on mac or 7zip on Windows.
-7z archives can be protected with encryption and a password and have a built in hash check.
-In Keka, choose 7z and store for no compression or normal for normal compression, then drag the folder to the Keka window.
-You can also split the archive in parts and upload the file in parts. Example 20 GB. If one of the parts is corrupted you only need to upload that part again.
keka

Use a PAR2 recovery file as backup
-You can use a PAR 2 file as an additional backup solution if there is no time to upload/download the corrupt files again . I have tried both MultiPar and MacPAR Deluxe to generate PAR 2 1 percent redundancy files. PAR 2 files with 1 percent redundancy are 1 percent of the size of original file. If the downloaded file is 0,5 percent corrupted, you can use the 1 percent PAR 2 recovery file to recover the file instead of downloading again. I have tried this and it works.

Amazon S3

Amazon S3 can be used to deliver and receive big files on the internet.
-You can use the s3 web uploader or use CrossFtp and similar programs to upload to S3. Crossftp Pro can use multipart and integrity checks when uploading so you will know the uploaded file is working.
-After uploading you can make the link accessible (public) and give the clients the S3 download link.
-S3 storage is very reliable and scalable. You pay for each download.
-If you want a client to upload a file to a s3 upload bucket you can make an upload user in https://console.aws.amazon.com/iam/home#users with a policy that enables the user to upload to that upload bucket.

Like this policy:

From http://docs.aws.amazon.com/AmazonS3/latest/dev/example-policies-s3.html#iam-policy-ex0:
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "VisualEditor0",
"Effect": "Allow",
"Action": [
"s3:ListBucket",
"s3:GetBucketLocation"
],
"Resource": "arn:aws:s3:::examplebucket"
},
{
"Sid": "VisualEditor1",
"Effect": "Allow",
"Action": [
"s3:PutObject",
"s3:GetObject",
"s3:DeleteObject"
],
"Resource": "arn:aws:s3:::examplebucket/*"
},
{
"Sid": "VisualEditor2",
"Effect": "Allow",
"Action": "s3:ListAllMyBuckets",
"Resource": "*"
}
] }

– then give the client the access key and secret key for the upload user. (with this policy the user will see all buckets, but can only upload to the examplebucket bucket.

 

Aspera Cloud
I have used Aspera Cloud on many DCP transfers. It is used by many film festivals and post-production services. It is very fast.

Google Drive
i have downloaded many DCP with free download manager from Google Drive. It is fast.

Dropbox
i have downloaded many DCP with free download manager from Dropbox. I had no problems.

DCP and quicktime specific advice

-When downloading a DCP folder in Filezilla from a FTP server, I downloaded the XML files and the rest of the files as binary to get them to pass the file hash check in Easydcp Player.

-Ask people who submit DCPs to use the archive format 7z instead of zip. This way you can avoid the (large) Mac OS archive utility zip files that can only be opened by the Mac OS archive zip utility. Both Keka and 7-Zip can make 7z archives.

-Sometimes I get a error message when opening a quicktime file on windows pc that was made on a mac. If I rename the file it works.

-I recommend checking DCPs in Easydcp player. The trial version will let you know if the DCP fails some checks. You can also run a file hash check.

You should also make a DCP quality checklist that may include:
-Is the DCP named correctly?
Is it in the correct scope or flat format? The DCP should have a correct digital naming convention name. Example: The DCP is called Dcpname_SHR_S but is actually Dcpname_SHR_F because the subtitles are burned in too low and will be cropped at a scope preset in your cinema.
-Is the DCP in the correct language/subtitle language?
-Will the DCP play at your venue. Example: You may have a server with old firmware that can play 25 SMPTE DCPs with burned in subtitles, but not SMPTE 2010 subtitles. (all film festivals have updated firmware).

-If you have downloaded a DCP folder archive like DCP.7z on a mac and want to ingest in on a digital cinema media block/server/player you can extract it to a DX115 hard drive or similar.

Other tips

-If you get an error message extracting a zip file in Keka that says error code 2 using p7zip, you probably need to extract the zip file with mac os archive utility.

Playing Blu-Rays in a Cinema

Blu-Rays and H264 files are sometimes used instead of DCPs when screening special content at cinemas.

Modern Blu-ray players send the video and sound signal through the HDMI connection. When choosing which Blu-Ray player to use in a cinema/movie theatre you should first check if you need analog 5.1 sound output.

Many Blu-Rays only have DTS MASTER HD 7.1/5.1 sound. That means no Dolby digital 5.1 bit-stream that can be used on the SPDIF input on cinema audio processors like the CP-650.

Players with analog 5.1 sound can connect to the analog 5.1 input on most cinema sound processors.

To connect the 5.1 phono output to a Dolby CP-650 and other cinema equipment you need an unbalanced 5.1 Phono to DB25 cable.
Like this one:
db25

Some newer cinema equipment may accept the DTS HD Master bitstream from HDMI or 5.1 uncompressed sound from HDMI.

Other features that is useful in a cinema:
-Common height (CIH) settings
-Lipsync adjust.
-Remove On Screen Display
-Adjust Brightness/contrast
-Advanced film/video/cadence detection for DVD.
-H264 Media file playback
-Adjust speaker trim level
-LPCM output
-RS232 control

The OPPO UDP-203 4K Ultra HD Blu-ray Disc Player has these features according to the manual.

More info on the features that are useful in cinemas:

 

Common height (CIH) settings
Useful if you want to adjust the placement of subtitles on scope films in a common height cinema.
A common height cinema uses a 2.39:1 screen.
If the subtitles are “burned in” below the picture you can´t screen the movie in scope and need to either make a custom preset on the projector or screen it in Flat.

Lipsync adjust.
Adjusting the sync with a sync clip played from the blu-ray player is helpful if the sound is out of sync.

-Remove On Screen Display
If you don’t want to show the play and pause icons it is important to turn off OSD.

-Adjust Brightness/contrast
Badly mastered Blu-rays may have elevated blacks or bad white levels, this is corrected with the Brightness (black level) and Contrast (white level) settings.

-Source Direct mode
Turn of video processing. Sends a clean signal.

-Advanced film/video/cadence detection for DVD.
Can auto detect if the DVD source is progressive (film) or interlaced (video). Can fix bad cadence.

-Media file playback
You can play MP4 and other H264 formats from a USB flash drive.

Resolve 11 adds 12 bit monitoring support with the BlackMagic Decklink 4K Extreme and the UltraStudio 4K

12 bit monitoring is great when grading LOG for digital cinema (DCP) on a 12 bit digital cinema projector.

To have the correct black level and correct contrast ratio you will need the correct review room contrast ratio in the cinema: 1500:1, 100:1 intra frame. Movie theaters have 1200:1.

You will also need the correct white light level (14 fL) in the cinema to get the contrast correct.

You will also need a dark room.

See this post for more info on good projection.

Resolve 11 beta 2/Desktop Video 10.1.3 adds dual link 3GB HD-SDI DCI 12 bit monitoring with the Decklink 4K Extreme and the BlackMagic Design UltraStudio 4K

12-bit 4:4:4 video monitoring support with Decklink 4K Extreme and Ultrastudio 4K (up to Stereo 2K DCI)

-What’s new in Resolve 11 Beta 2
BlackMagic resolve website