What I was doing, RichCopy now..


First of all I’d like to apologize for being away for so long and not actively updating this blog.


Today I will share what I was doing while I was away. My group is responsible for ensuring the quality of products aimed at enterprise customers as well as accelerating innovation through the engagement and joint activities with software and hardware partners. Over the past year I have been working almost exclusively on setting up our new facility, “Microsoft Otemachi Technology Center” in downtown Tokyo, Japan. This is a rather unique facility as it houses both MIC (Microsoft Innovation Center) and MTC (Microsoft Technology Center) as opposed to the usual model of having one facility dedicated to one center. MIC focuses on accelerating innovation and stimulating the local software economy with Microsoft technology, and MTC, which is for enterprise customers, “…is a collaborative environment that provides access to innovative technologies and world-class expertise, enabling you to envision, design, and deploy solutions to meet your exact needs” (MTC Web site). I was the project manager for every phase in setting up this new facility in Tokyo. My role not only involved driving the project, but I was also responsible to the entire design process from designing the office layout and infrastructure to setting up the switches, cables, etc. This new facility has 5 briefing rooms, 2 solution experience room, 1 envisioning room,  1 datacenter and 1 topology lab. Here is look like.





 


OTC


Datacenter


 


Briefing Room


Briefing Room


 


Microsoft is committed to reducing carbon dioxide, and I spent a lot of time designing this new facility to minimize energy consumption, especially in the datacenter, which accommodates a total 40 server racks. In many cases, customers pay attention to server and storage energy consumption, but not the air conditioning infrastructure. At a typical datacenter, not container base, server and storage consumes less than 50% of total energy; the rest is consumed by lighting and air conditioning. Thus facility infrastructure is quite important for better PUE (Power Usage Effectiveness). Also this new facility hosts an environment for product testing, such as Exchange Server, SQL, and System Center’s management solutions. Network infrastructure was another key area.


 


Focuses are:


       Central management and monitoring of PDU (Power Distribution Unit) and Air Conditioners, not only server hardware and OS.


       Independent air conditioning control (per Server rack) to avoid unnecessarily cold lab.


       Maximum efficiency of cooling by minimizing the diffusion of hot air for high cooling efficiency. *Hot Aisle Containment


       Typical datacenter/lab configuration, not container, as our customers and partners come to visit and use them.


       Higher network bandwidth.


 


What we’ve chosen is APC’s datacenter solution. APC is Microsoft’s technology and solution partner, and they have rack and power solutions that satisfy the majority of the needs mentioned above.


Here is what the new center has deployed:


 


Summary of infrastructure


Rack


       APC’ Datacenter solution


Ø  NetShelter Racks with HAC (Hot Aisle Containment)


Ø  InRow cooling


Ø  InfraStruXure PDUs


       HP ProCurve, Brocade and F5 for network solution.


Network Cables


       CAT6A


       OM3, ribbon cable for interconnection between racks and labs. (MPO/MPO)


Switches


       HP ProCurve, Brocade and F5 for network solution.


       80G bps interconnection between labs.


       10G network ready (CX4, SR)


       FCoE


Storage


       iSCSI (1000Base-SR 1000Base-T, 10G Base-SR [SFP+])


       Fibre Channel (2, 4, 8G bps)


       FCoE (10G bps)



 


Hot Aisle Containment 


HAC (Hot Aisle Containment) to minimize the diffusion of hot air for high cooling efficiency. 


 


Core switch with 10G modules


 


RichCopy


Long path, reparse point, some missing command options, etc will be addressed in next release. It will be released in a couple of weeks.


 

Comments (80)

  1. Anonymous says:

    New update will support long path and option to hide splash screen.

  2. Anonymous says:

    Gary

    Ken, can you please make RichCopy to show separetely when copying process is finished and verifying process is started (in “Verify” method)?

    And what actually happens to files at destination if in the middle of copyin or verifying process something causes RichCopy to crash or PC to shutdown… How to check if those files were copied and verified completely?

    Thank you.

  3. Anonymous says:

    First let me say the utility is excellent.  Perhaps I am just missing it; I have not seen any command line options for date based inclusion/exclusion.  If all of the program options had a corresponding command line option that would be great.  I would also like to put my vote in to have the utility to become part of the free OS resource kits.

  4. Anonymous says:

    Sorry for previous mistake. I just wanted to put my name Gary in first line of the text to show it instead of Anonymous. But Technet put all line together! Sorry. Web-admins should certanly fix it! 🙂

  5. Anonymous says:

    I read most of the earlier posts concerning ACLs, etc. not transfering over for various reasons, and I’m wondering if anyone has used RichCopy for the bulk file/folder transfer, then used Robocopy to fix ACLs, timestamps,updating, etc.? Yeah, it would be nice to have it all in one single app, but hey, it’s free!

    Domarigato Ken-san for your time and effort – gambare!

  6. Anonymous says:

    Hello, Ken.

    Congratulations on a great looking facility. Well done!

    I am happy to see that you will be able to spend some time on RichCopy again 🙂 Will shares be included in the new version?

  7. Anonymous says:

    Hello RichCopy users. Thank you for using RichCopy. I apologies I have been away too long. Yes, there is an updated version of RichCopy with synbolic link, few other additional features and bug fixes; however I still need several more weeks in order to have spare time to finalize. I will review all feedback posted on this thread, and try to take into the next release.

  8. Anonymous says:

    Ken,

    Great product. I am just having problems with the timer switch. This does not seem to work at all. I am using Richcopy64 on 2008 server r2. Any ideas?

  9. Anonymous says:

    That is a very nice facility. Show us more and bigger photos 🙂

    Can new version hide the splash screen and GUI when RichCopy is run from the command line?

  10. Anonymous says:

    Ken, your work on RichCopy is much appreciated by us out in the trenches.

    Any chance you will add a SFTP connection method to RichCopy? In my environment, we are quite concerned about security of passwords, etc.

    Thanks,

    Gary

  11. Anonymous says:

    It is possible to test what files will be copied or deleted? (The /L flag of robocopy).

  12. Anonymous says:

    this tool is pretty cool but i was wondering if there will be the option to copy files with more than 255 characters (like robocopy does). is it going to be a feature soon? (..i hope so :))

    thanks

  13. Anonymous says:

    Hello Ken, really good to see you back !!!

    I'm not sure if in previous comments the necessity of support for SeBackupPrivilege and SeRestorePrivilege as in robocopy /b was mentioned.

    Waiting eagerly…

    Many Greetings

    Michael

  14. Anonymous says:

    bigger pics pls!  Awesome work

  15. Anonymous says:

    Nice work on RichCopy Ken.  We needed a multithreaded copy tool for a long time.  It would be perfect if the ACL issues were resolved :).

    Thanks for your hard work.

    Oscar

  16. Anonymous says:

    How do you exclude multiple directories in RichCopy?  I tried separating names with semi-colons inside double-quotes (e.g. /FED "DIR1; DIR2"), but that didn't seem to work.

  17. Anonymous says:

    Ken – Any updates?  I can't find 4.0.217 for download from any MICROSOFT site, only 3rd party sites I have never heard of and I am afraid of installing a trojan or malware.  Why can't I find the RichCopy download from a Microsoft site?

  18. Anonymous says:

    Hello Ken. Please, let RichCopy to keep original modification dates of folders at destination. Only creation dates are kept now….

  19. Anonymous says:

    And also, what about the possibility to handle long paths/file names? Will that be included in the new version?

  20. Anonymous says:

    I’ve tried to set up RichCopy via command line in a way that it shouldn’t overwrite existing files. /NE without any other "conditions" switches should do it, but it doesn’t. I saw that when I switch in the GUI from Time stamp is… "Updated" to "No check", it ADDS a /TSU in the command line paramters window in "Options". Alright then, but even with /TSU in my command line it kept on overwriting files with updated time stamps. Any advice on this? Any chance to fix it for the upcoming update?

    By the way, /CNF obviously is "Create directory only when it has child" and has – here in 4.0.217 – nothing yet to do with suppressing any popups.

    Thanks for the good work, Ken! I really appreciate how well RC can be customized. For me, the main advantage was that it offers copy verification and a CLI.

  21. Anonymous says:

    Excellent, can’t wait. I was just about to download the old version, but will hold off for the next release. Long path support will be a huge benefit.

  22. Anonymous says:

    Hi,

    Last time I tried RichCopy it was fragmenting files…For example, when copying a large file it would create the file, and then write to it (you can watch the file size grow by refreshing the target directory window while copying).  As the file grows, blocks are allocated and the file is fragmented.  The file size should be set immediately after creating the file so that the file system can try to keep it contiguous.  RoboCopy did this correctly…

    Is this still being updated?  Where, please?  The RoboCopy Gui page insists RichCopy is the greatest thing and everyone is using it…so, updates?

    I know it's probably not the highest priority in the world, but it's such a minor fix for a problem that is quite irritating once you know it is happening and I can't use the tool when I know my files are being turned to spaghetti on the hard disk…

    Thanks

  23. Anonymous says:

    Any updates on when the new RichCopy will be released?

  24. Hugh says:

    We realise RichCopy is not your "only job" but it has been 4 months since the "where I have been" update and getting close to a year since the last update to RichCopy (June 2009). Are you still there and if so is this an "active" project that may get some work at any stage ?

    Thanks for the excellent piece of software. It just needs some attention, please.

  25. Billy G. says:

    This is exactly why RichCopy should be OPEN SOURCE!

    I don't know why this or a more advance file operation function isn't already built into Windows or any OS for that matter.

    I hate it when you go away while copying large files, only to return to find some prompt or error has occurred… and if you have bad lucky, near the beginning of the operation 🙁

    Keep up the good work!

  26. claudio says:

    why does robocopy or richcopy make this _img697.imageshack.us/…/tempqf.png ?

  27. Kel says:

    I have just install the RichCopy, but it did not come with the Additional Copy options.  I only see "Overview", and the program does not show "Process control", "Attribute, Errors", Etc.  Why is this?  Which version has thes options?  Send response to morrissettefam@live.com

    -Kel

  28. Hugh says:

    To get all the extra options select View -> Advanced (is a "check box") then when you click the the Options button you have all the various features.

  29. matthias says:

    Please, anyone. I'd just need the RC command line option for "don't copy if file exists in destination/don't overwrite existing files." That's all. If it's implemented, then what is it? /NE doesn't work. Ken, anybody? I built a larger synchronization routine around RichCopy (including parsing RC's logfiles for errors) and I don't want to adjust it to another copying program but need to have it work shortly.

    Thanks a lot! – Matthias

  30. Riccardo Sinopoli says:

    Hi Ken, there is some news regardin long path support? we're really appreciate this fix that could help us in transferring files between storages.

    This app is really good and support also Mixed environment ACL between unix and windows (CATIA)

    Thanks

  31. Gerry Mayfield says:

    Reading a lot of people having trouble with 'exclude' directories not working. Me too! Fill it in and then reopen the save file and the directories are listed but the exclude box is unchecked again. Is there some screen shots somewhere of how to use this properly? I am sure it must be a usage error but can't figure where I may be going wrong.

    Thanks

  32. Jarno says:

    I would appreciate if Microsoft took real, commercial responsibility over RichCopy. It is very handy and needed tool starting from homes and small offices to bigger deployments.

    OR if RichCopy would be open source then people could leave Ken more time for his actual work and fix the bugs themselves;-)

  33. Scott Williford says:

    I've been using PowerShell and RoboCopy to copy a list of files (list.txt) to a new destination.  I just found out about RichCopy and would love to be able to use RichCopy since it's so much faster.  Is there a way to provide a list of files in a text or csv file to RichCopy then have it run through a source directory tree, copy just those files and mirror the directory tree.  with RoboCopy and PowerShell I use the following.

    gc list.txt | % { robocopy c:source c:dest /MIR $_ }

    This code gets the content ('gc') of the file list.txt, and for each ('%') line, it executes the robocopy command  with the /MIR copy option to mirror the directory structure ('$_' represents the current line).  I've also include /MOV when I want to move the files.

  34. Jason Miller says:

    How about the ability to copy to multiple destinations at the same time… ie an OU for our servers.  This would be great… if it can already be done I'd gladly take some advise on how it's accomplished.

    Pics look great!

  35. Ravs says:

    In robocopy there is parameter MINAGE and MAXAGE which is really useful to copy or archive file based on the system.

    Is there is same option/parameter available in richcopy also . actually i have use this in commandline.

    Any post is appreciated.

  36. Kevin Torpey says:

    I work in storage operations for major finaincial institutions.  I was able to run Richcopy from the command line with directory exclusion.  Note that the help doc is incorrect that the switch is /EDO, the switch is actualy /FED "dir_name".  Unfortunately in my tests, it does not allow for multiple directory exclusions.  I am also having issues with paths greater than 256 characters.  Still waiting for the new version.  Ken, how about letting some of us beta test it for you?

  37. Kevin Torpey says:

    I work in storage operations for major finaincial institutions.  I was able to run Richcopy from the command line with directory exclusion.  Note that the help doc is incorrect that the switch is /EDO, the switch is actualy /FED "dir_name".  Unfortunately in my tests, it does not allow for multiple directory exclusions.  I am also having issues with paths greater than 256 characters.  Still waiting for the new version.  Ken, how about letting some of us beta test it for you?

  38. Bridget says:

    Really like RichCopy Ken.  Is there a way to minimize the splash screen and GUI when RichCopy is run from the command line?  It was mentioned this would be fixed in the next version, what is the latest and greatest version? 4.0.217?  Any help is greatly appreciated!

  39. Wes says:

    Ken, as per the above comment from Bridget, any update on where the latest version of Richcopy can be downloaded from??

    Also, just wondering which ports / protocols RichCopy uses to do the file copies, as I'm using it within a locked down DMZ space to copy between servers in the DMZ and also from servers outside the DMZ into it, and I'm finding issues copying to some servers and not others, and I'm currently not able to work out which specific ports / protocols need to be open for it to work.

  40. Elias says:

    He hasn't responded to this blog forever. That stupid splash screen needs disabled, and a 100% silent process needs to be available…I can't utilize the super fast processing with it popping up on my screen.

  41. JasonG says:

    Yes, please see if a PM can have this put up on codeplex

  42. Paul Danger Kile says:

    Thank you for RichCopy.

    Best… data-center… evar.

    Paul Danger Kile

    dangerismymiddlename.com

  43. David Hibberd says:

    RichCopy is a great tool; I too would like to see some updates.  From time to time I get network problems that even Richcopy cannot span and if these catch a file halfway copied I end up with an incomplete version of that file with today's date!  If RichCopy followed the RoboCopy practice of setting an arbitarily early file date on a file when it starts to copy then updating the timestamp when the transfer is complete it would avoid the incomplete files as being mistaken for more up-to-date versions…

  44. tetsuo says:

    can you share source code ?

    thank you

  45. Gary says:

    either I sorted out my confusion, or I am still confused.  it seems the diagrams in the help for "consolidate multiople sources" are reverse to the descriptions, at least in 4.0.217

  46. Ofek Shilon says:

    Ken – thanks a lot for a badly needed utility!

    I thought of submitting some bugs – but i see (and *fully* understand and appreciate) that you probably don't have time to fiddle with RichCopy now.  

    So I'm taking the liberty of making a different suggestion:  how about making it open source? (in CodePlex or elsewhere).

    Myself, and i'm sure many more qualified developers, would be happy to try and dive in and take the support burden off your shoulders – or at least help out a bit.

  47. Ofek Shilon says:

    Ken – thanks a lot for a badly needed utility!

    I thought of submitting some bugs – but i see (and *fully* understand and appreciate) that you probably don't have time to fiddle with RichCopy now.  

    So I'm taking the liberty of making a different suggestion:  how about making it open source? (in CodePlex or elsewhere).

    Myself, and i'm sure many more qualified developers, would be happy to try and dive in and take the support burden off your shoulders – or at least help out a bit.

  48. markus says:

    For me one significant performance relevant technique is missing in RichCopy.

    Let me cite it from FastCopy's web page (ipmsg.org/…/fastcopy.html.en):

    "Verify written files data by MD5(or SHA-1."

    "Action detail: Read(Src) -> MD5(Src) -> Write(Dst) -> Read(Dst) -> MD5(Dst) -> Compare MD5(Src/Dst)"

  49. LK says:

    Dude, you need to blog regularly or delete this blog. There is no point in blogging once in an year.

  50. johnny says:

    Richcopy seems to have a problem with "ampersands" in the folder names.

    Is this something you are going to be looking at?

    thx,

  51. Don says:

    Love this tool, any chance we can get the source code?

    Thanks

  52. Keith says:

    What is the latest version of RichCopy?  When is the Trickle option going to be functional?

    Thanks

  53. mike says:

    Has RichCopy been removed from the Download Center?  I was not able to find when I checked today (3/9/11).

    Thanks!

  54. Andrew says:

    How to use RichCopy with FTP, i have error 3.

  55. Kevin says:

    With v4.0.217, I keep getting code 5  Access is denied errors on files with the read-only attribute.  It looks like all the files are copied, but when I select to Move files, these read-only files get left behind in the source directory.  Is there a way that RichCopy can also delete those files too?  It was a pain to manually verify hundreds of these "errors".  If I uncheck error 5 in the "File attributes, Error Handling", I get the same results…log shows errors, files copied not moved, and files remain in the source directory.

    Thanks!

  56. Rein says:

    Come on man, bring out the new version! (Or at least release the source code, please!) The world knows you through RichCopy, not the Otemachi Technology Center… We all appreciate your software!

  57. Phil says:

    Ken, dude, we love you, we know stuff is going down in Japan. Please make this open source or something. There's shockingly not *better* options, just alternatives and if this was updated with fixes mentioned above it would be perhaps the best file transfer assistant we have at our disposal.

    Thanks for your hard work but there are many folks who could give/use a hand! Don't leave us hangin ^_^

  58. Amit says:

    Guys, I think this is a dead blog and a dead application.

    About the only thing Richcopy was good for was multithreaded copying, well guess what… the robocopy that ships with windows 7 has that feature with the /MT[:n] switch.

    technet.microsoft.com/…/dd542631.aspx

    Cheers.

  59. nobody4 says:

    i was having trouble excluding multiple directories using RichCopy.  Originally i had spaces after the semicolons and double quotes around all.  It woudl only exclude the first directory.  Thsi was fixed by removing the spaces.  Just fyi

  60. Jorricks says:

    Will the HELP tab oh the GI ever offer help other than current message that states:

    "RichCopy Failed to Launch Help"

  61. SpeakEZLanguages says:

    Ouch???  Nice data center! Glad to see RichCopy hasn't totally died – or, has it?

  62. matthias says:

    Hi, I discovered this morning this utility (RichCopy version 4.0.217). Here are some bugs I found. If I didn't post this message at the right place, please let me know by sending me an email at shiftcode@gmail.com. (Speak only in english, I'm french) :

    1) When I change the "Default" option profile, changes made are not copied to a new profile when you click on "New" : I though this "Default" profile acted as a template for new options.

    2) When you load an .rcx file with source and destination directories save in this file, these default directories are not reported to the main window from which you launch the copy action. Worse, if source and destination fields are empty in the main window, the software does not try to check if they are filled in the "default directory" of the .rcx file  `:-(

    3) in the .rcx file, in the "Files to be excluded" section, when you check "Use name to filter …" or "Use attributes to filter …", and you reload the .rcx file (after saving it), checkboxes are unchecked, even if you filled fields below these checkboxes.

    4) "Use name to filter directory" in the "Files to exclude" section does not work. My example : I try to save my Thunderbird profile file, that contains a "Crash reports" folder I don't want to copy. So I check "Use name to filter directory" and write "Crash reports" into the field below (without doubble quotes). Then I check "Use attribute to filter directories" and check "System file". When I launch the copy, the Crash reports folder exists in my destination folder, even if I delete it and relaunch the copy !

    Conclusion : for the now, I will keep on using Robocopy utility, which seems to be more reliable (never crashes, whereas your application sometimes crashes when clicking on "error handling" section)

    5) Here is a "nice to have" : the ability to say "don't do anything, just tell me what you will do if I ask you this". In other words, the equivalent of a "whatif" in PowerShell or the /L option in Robocopy.

    Thankx.

  63. Vladimir says:

    Hi Ken.

    I'm just staring with RoboCopy and I'm thinking of using it for Backup insted of Windows Backup.

    Your program seems VERY usefull.

    Are you going to release an update for Windows Server 2008 R2?

    Thanks!

  64. alex says:

    RichCopy 4.0 is 2008. Are there any updates to the Tool?

    PS: There is an issue. While COPYING DIRECTORY TREES, the CREATED & MODIFIED Dates for FILEs are COPIED but the same is not the case for DIRECTORIES/ FOLDERS.

    Can this be created / added as an option?

  65. sunny says:

    It's over a year since the promised update. Any chance of it coming soon? Bug fixes would be great.

  66. Gordy says:

    Any chance for an update to RichCopy?

  67. Pete Holzmann says:

    Hi Ken,

    A current bit of feedback on RichCopy latest release: unfortunately, it does NOT replicate folder timestamps. Very sad… as no other windows tool (not even current robocopy with dcopy:t) does that either. So close but so far. Glad to alpha/beta test anything for you. (Ted O @ MS Humanitarian Sys can connect you to me.)

  68. Dan_IT says:

    Hi Ken,

    please, fix long file name (>255) copy issue, RichCopy crashes with this files.

  69. haiko says:

    just found rich copy,

    perfect!  just what I wanted.

    are there are any ready made setups to something like:

    "mirror the directory, but only copy files if filesize is different"

  70. Craig says:

    Richcopy is a fab tool that saves me hours every month synching changes from my C:users<myname> folder to a pendrive that I use as backup device.

    Since my configuration only syncs changes, it runs very quickly for me, except when the clocks go forward an hour in the UK every March. In this month, the configuration I use causes all files to be deleted and rewritten to the pendrive. I think this is down to the last access date/time for pen drive files shifting by one hour on my laptop. When this happens, my sync time switches from 8 hours (which I run over night) to something like 4 days instead.

    One solution to this might be to your developers alter the 'Time stamp is…'updated'' option on the overview screen so that users can tell rich copy when clocks have gone forward or back by 0 (none), 1 or more hours.

    I also recommend producing a list of FAQs or walkthroughs for the top 5 ways of configuring Richcopy.

    Even if you decide not to action any of my suggestions, I still wish to thank you for producing a fab tool that has reduced what used to be a laborious and stressful chore into something that is now very easy to do, saves me hours each month and helps me to sleep better!

  71. Hugh says:

    Ken, you last posted in November 2011 that "… need several more weeks in order to have spare time to finalize." We know you are busy but any idea when the update will be released ?

  72. Rainer says:

    Hi Ken,

    great job, with the help of http://www.symantec.com/…/readyhow-replicate-file-shares-using-microsoft-richcopy I was able to get the settings properly, and the log.

    Any idea when we'll see an update of RICHCOPY, it's worth to keep it alive!!

    BR

  73. paul says:

    New version would be great. Whatever updates you have… thanks Ken.

  74. Frank W. Vans Evers Florida says:

    question: Where is/are the logs placed, I can find the name of the log but can not view it??

    /s/ Frank in Florida, frank.vansevers.ctr@socom.mil

  75. Mike Demster says:

    Can we RoboCopy Ken, and have his copy work on the next release?

  76. John Philip says:

    The consolidate option doesn't work for me. Is it working for anyone else?

  77. Tyan says:

    The PURGE function if there are multiple directories selected as source gives error 87 at the start of  the process as others in past have said and I can confirm… 🙁 also there is the long path name problem.Maybe there will be an update in future but for now there are a lot of bugs, too much for be useful if you need a small but reliable copy utility 🙁

  78. Ed Keller says:

    Love the tool but I keep getting "Error is occurred during the copy process" with and error number of "0"  Does anyone have any idea what causes this?

  79. Fan says:

    Please fix bugs

  80. lfassio says:

    Hello Ken,

    your last post is about 4 years ago, so it is clear that you are really busy with your other challenging activities.

    Why don’t you (as Microsoft ofc) put the tool in the public domain so all the people interested can contribute and make it live and grow?

    In the CMS arena, Orchard (http://www.orchardproject.net) is an interesting example where Microsoft went open source.

    Best regards.