Saturday, July 9, 2022

Fast backup of files

Video: Fast backup of file shares - No load, ransomware protection, fast restore

Millions of files? Huge number of TBs?
Slow backup? Issue with restore?

There is a solution! You can backup any file share fast, secure and with easy restore!
https://youtu.be/LETxuJZXnuA
See summary of what PowerProtect Data Manager offers for backup of CIFS/NFS - any NAS shares!

  • Huge fast - backup every hour! 
  • Hardware agnostic
  • Fast restore

Direct link to the video: https://youtu.be/LETxuJZXnuA

Detailed description of topics covered in the video:
0:05 - Backup of files can be pain:
https://www.youtube.com/watch?v=LETxuJZXnuA&t=5s
 - load
 - time

0:30 - Agenda
https://www.youtube.com/watch?v=LETxuJZXnuA&t=30s

0:50 - Why do we talk about backup of files?
https://www.youtube.com/watch?v=LETxuJZXnuA&t=50s
 - we talk about CIFS/NFS that is tough to backup
 - no agent possible as for Windows NTFS use case
 - we have millions of files / hundreds of TB
 - backup is slow - even days
 - restore is slow, restore point is long time ago

2:58 - We talk about PowerProtect Data Manager
https://www.youtube.com/watch?v=LETxuJZXnuA&t=178s
 - can backup fast CIFS / NFS shares from any vendor

3:29 - Architecture of the backup file share
https://www.youtube.com/watch?v=LETxuJZXnuA&t=209s
 - we have FULL backup by only reading what has changed since last backup
 - backup is huge fast because we read only delta
 - PPDM performs only FULL backups - though reads only delta
 - no incremental / differential backups - only FULLs 
 - huge important because FULL backups provides fastest restore and possibility for granular restore

6:40 - Value
https://www.youtube.com/watch?v=LETxuJZXnuA&t=400s
 - no load of protected system / protected system does not feel the backup
 - no load of network - protected share can be far from media
 - backup is huge fast / I can perform backups frequently 

8:12 - What does t mean that every backup is full but we read delta?
https://www.youtube.com/watch?v=LETxuJZXnuA&t=492s
 - if 2 files have changed, we will read just them
 -  we have a full backup
 - this is magic and incredibly fantastic

10:12 - PPDM uses BOOST protocol
https://www.youtube.com/watch?v=LETxuJZXnuA&t=612s

10:25 - It is magic and fantastic!
https://www.youtube.com/watch?v=LETxuJZXnuA&t=625s
 - during couple of minutes we can have a full backup

 10:45 - PowerProtect Data Manager demo
https://www.youtube.com/watch?v=LETxuJZXnuA&t=645s
 - PPDM just controls backups - does not take part in data movement
 - we add a new policy for CIFS backups
 - we choose share
 - we can choose synthetic full - full with reading delta

12:35 - Automated dividing for streams / slices
https://www.youtube.com/watch?v=LETxuJZXnuA&t=755s
 - dynamic slicing
 - every 200 GB is single stream
 - 3 streams for 600 GB data
 - every 1 million of files is single stream
 - 5 streams for 5 millions of slices

14:15 - demo - setup maximum number of streams for particular share
https://www.youtube.com/watch?v=LETxuJZXnuA&t=855s
 - we do not want to use to many streams for particular streams
 - limiting streams for a large number of TBs

16:15 - The backup is controlled by proxy
https://www.youtube.com/watch?v=LETxuJZXnuA&t=975s
- PPDM controls backups from aside 
- proxy is installed automatically from PPDM
- I can have many proxy - every of them is 24 streams

17:26 - This is functionality for all possible CIFS/NFS shares
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1046s
 - any CIFS any NFS on whatever storage
 - hardware agnostics
 - we can enjoy huge speed
 - it is just software / proxy
 - proxy is just Virtual Machine
 - we can add a new proxy / VM to add streams
 - 24 streams per proxy

19:12 - How many Data Domain systems are supported?
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1152s
 - as many as we want
 - we can use bigger one - DD9900 - almost 2000 streams

19:38 - No agent required
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1178s
 - agentless 100%
 - we do not install anything - also on the backed up share
 - adding a new share - we will se no agent is required
 - showing how simple is adding a new share to PowerProtect Data Manager

21:20 - Proxy binaries are within PPDM
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1280s
 - demo how easy is to install the proxy

21:50 - Only first backup is reading whole data
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1310s
 - every following backup is reading change but we have a full backup

22:07 - Proxies are deployed manually
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1327s
 - we shall have more calculate how many streams we require
 - if we need 50 streams probably we need 3 proxies (x24 - 72 streams) - to have some buffer

22:47 - What do we get? Summary:
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1367s
 - Speed 
 - Frequent backups
 - All backups are FULL
 - Immediate restore
 - Granular restore

23:02 - Protection against ransomware / hacker attack
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1382s
 - we can setup retention lock
 - demo - setup retention lock live in PPDM
 - production can be deleted but our backup will survive

24:17 - Self-backup infrastructure
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1457s
 - demo of self-backup infrastructure
 - when we create policy we need to manually say which shares we want to backup
 - but we want that PPDM automatically add new shares connected with PPDM
 - showing dynamic filters live
 - all shares that in the name contain k8s must be automatically backed up
 - we see that now PPDM will backup 4 shares having k8s within name
 - we can also say that big shares go to one policy / small shares go to another policy
 - all backups from some Isilon shall go somewhere
 - Self backup infrastructure is available only for Unity / PowerStore / PowerScale

27:35 - What is Self-backup infrastructure?
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1655s
 - PPDM asks NAS and asks if there are new shares
 - if this no name share, PPDM cannot scan for new shares, no one to ask for new resources to backup

29:00 PPDM supports any CIFS / NFS
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1740s
 - huge fast backup for any share
 - for self-backup infrastructure we need supported system to ask about new resources

29:34 - Do we need any post-backup for always FULL?
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1774s
- NO any post backup actions required
- We have FULL backups like that!
- Please test it and touch it on your own

30:15 Restore
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1815s
 - we have many backups of different shares
 - backups of NetApp / Qnap
 - we can restore to the same NAS
 - we can restore to Linux / Windows
 - we can restore to any target
 - we do not use NDMP 

31:52 Granular restore
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1912s
 - we can restore single file

32:15 We can search for files
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1935s

32:38 Summary
https://www.youtube.com/watch?v=LETxuJZXnuA&t=1958s
 - Great solution that can help with time, many files, large volumes
 - Very cost effective
 - Look more closely
 - Future - show the numbers
 - I am very excited about technology
 - See you next time!

-
Presentation from the event:
https://drive.google.com/file/d/1A0rw8daVoBHsOmoOlFwxFm9xGONQnJon

-
Materials:
Backup and Recovery - all materials: http://backuprecoveryguy.blogspot.com/2022/07/backup-and-recovery-materials.html
BackupRecoveryGuy: Backup and Recovery materials
-
Fast backup of files - video: https://youtu.be/LETxuJZXnuA
Fast backup of files - article and presentation: http://backuprecoveryguy.blogspot.com/2022/07/fast-backup-of-files.html
-
Performance in backup: https://youtu.be/05fFtGH7YCQ
-
DD6400 video: https://youtu.be/8ieVepB2kno 
DD6400 article: http://backuprecoveryguy.blogspot.com/2022/07/data-domain-dd6400.html 
-
New generation of Data Domains DD6900 / DD9400 / DD9900
Video: https://youtu.be/xx-xZC9JtoM
Article: http://backuprecoveryguy.blogspot.com/2019/12/why-new-data-domain-models-dd6900.html
-
What is new in Data Domain 7.2?
Video: https://youtu.be/m1XNy6IXzOo
Article: http://backuprecoveryguy.blogspot.com/2020/08/data-domain-72-what-is-new.html

Only successful restores!
BackupRecoveryGuy

Thursday, October 21, 2021

Transparent Snapshots - Frequent, Easy, Low cost VMware backups!

Video:
BackupRecoveryGuy: Transparent Snapshots - Frequent, Easy, Low cost VMware backups!

Transparent Snapshots is breaking technology for VMware backup and recovery.

In short Transparent Snapshots:

  • Decreases backup costs
    Eliminates any additional serves, components, networking, etc.
  • Allows to backup Virtual Machines even every 15 minutes
    Huge fast backups
  • In case of ransomware, we can restore to very rcent point of time
  • Backup is super easy
    We can be setup in 3 minutes
  • Transprent Snapshots can be implemented for tens or thousands of Virtual Machines the same way
  • Tranpsarent Snapshot is technology fully supported by VMware
Please find below the video describing the  Transparent Snapshots technology with licensing and demo.
Direct link to the video: https://youtu.be/7HT3_FmNJcs



0:00 What do we require from vmware backups?
1:04 Agenda 1:24 VADP issues and history 4:08 - RP4VM bypases VADP the problems 4:40 - What does give us Transparent Snapshots? - always available - simple - no proxy - very fast - no snapshots of vmware - we do not load or pause vms 6:14 - Architecture of Transparent Snapshots 10:30 - Value of Transparent Snapshot 13:35 - PPDM - backup solution that implements Transparent Snapshots 14:50 - PPDM - self backup architecture 17:10 - Why Transparent Snapshots? No proxy, directly backup from ESX - cost savings, no impact on production 20:00 - Why PPDM? 21:44 - Transparent Snapshots requirements 22:04 - Comparison betwenn VADP and Transparent Snapshots 22:50 Licensing 26:00 Demo Policy, self backup Transparent snapshots HUGE FAST backups - 23 seconds - the real time of backup! 31:50 Summary / value of Transparent snapshots

Fast, easy and always successful backups and restores!
Daniel Olkowski

Monday, September 6, 2021

Cyber bunker - architecture, network, recovery - remote discussion, 30 minutes, Friday, September 10, 12:00 Vienna time

Register for the discussion!
https://us02web.zoom.us/webinar/register/WN_UyLDrT68RB2I-NI6qMdvow

Cyber bunker provides recovery after hacker / ransomware attack, allows verification of production, is fully automated.
That is why it is gaining more and more popularity.

But
   * How does cyber bunker look like?
   * How is connected with the rest of the world?
   * What happens in the bunker when the attack starts?
And the most important: What is the cost?

Let me invite you for 30-minute journey into inside of the vault:
    Cyber bunker - architecture, network, recovery
When?
    Friday, 10th of September, 12:00pm CEST (Vienna time) – 30 minutes
Registration:
    https://us02web.zoom.us/webinar/register/WN_UyLDrT68RB2I-NI6qMdvow
Internet invitation:
      https://www.linkedin.com/feed/update/urn:li:activity:6840897666889646080/

We will see cyber bunker construction, networking, TCO.
And ... we will simulate the attack!
    https://us02web.zoom.us/webinar/register/WN_UyLDrT68RB2I-NI6qMdvow

Before our meeting have a look on video about Cyber Recovery: https://youtu.be/jtgm2WHpFPk
And article: http://backuprecoveryguy.blogspot.com/2020/01/ransomware-attack-how-can-we-recover.html

Prepare coffee, questions and ...
See you in the bunker!
Daniel Olkowski


Friday, September 11, 2020

How to protect virtualizations? - Red Hat, oVirt, KVM , Xen, Oracle, Nutanix, Proxmox



Direct links to the above discussion about protection of virtualizations like Red Hat, oVirt, KVM , Xen, Oracle, Nutanix, Proxmox: https://youtu.be/Ym7_GNcB0qI

-----------
Here are the links to particular topics from the conversation:

1:04
What is vProtect?

1:40
vProtect architecture
2:55
1 phase backup with Data Domain with source de-dup
4:11
Server and node
5:15
Scalability

5:57
Installation of vProtect

7:51
vProtect demo

8:15
Functionalities
8:20
Backup of images
9:00
Snapshots kept on the virtualizations
11:00
We can restore just the state of VM
11:40
Self backup infrastructure

14:05
Recovery plan
One button recovery
Scheduled recoveries

16:15
Backup cinsistency

17:10
Data Domain integration
Source de-duplication

17:46
Huge speed customer example

19:25
vProtect and source de-dup in the same license bundle

19:59
Summary of functionalities
Full backups
Incremental backups with CBT
Restoring single file
Mounting disks from backups to virtualixzation paltform
Disk exclusions
Self backup environment
Pre and post commands
File level restore - question

22:58
GUI
backup on demand
Starting bckups
Creating automated policy
Creating recovery plan

26:20
Great CLI interface

27:20
Trial

27:34
How vprotect is licensed?

Protect everything!
BackupRecoveryMan


Thursday, August 27, 2020

Data Domain 7.2 - What is new?

Performance & Security - these are flagship Data Domain features.
They are further improved in new Data Domain 7.2.
Let me invite you for short discussion about new DD 7.2 features.



Direct link to the above discussion about new DD7.2 features: https://youtu.be/m1XNy6IXzOo

What is new in Data Domain 7.2?
1.
Compliance - absolute lock for protected data

Data Domain allows you to absolutely block backups for a specified period of time. Thanks to this, neither ransomware nor hacker can hurt our data - we can always restore from Data Domain:

Data Domain blocks data removal / change for defined period of time (month / quarter / …) Hacker cannot change to bypass the lock - neither directly nor through the NTP server:

Version 7.2 further extends the flexibility of compliance. We can define the maximum time change applied to Data Domain and the maximum number of changes:

The compliance function is available in Data Domain hardware appliances:

------------
Further extension of Compliance (no removable lock) is Cyber Bunker:
https://youtu.be/jtgm2WHpFPk
described in the article:


2.
How much more space do we gain with new Data Domain models?

New Data Domain models compress new blocks more effectively thanks to dedicated compression card:

And we also gain more performance:

How much do we additionally gain thanks to compression card? The video shows the real numbers from production, worldwide Data Domain:

Let's assume that the old Data Domain would need 100TB for data storage.
New models (DD6900 / 9400/9900) will need
  • only 77TB for storing backups for securing your file system
  • only 85TB for storing backups for securing databases
Detailed explanation of the mechanism that makes new Data Domains to use less space for backups: https://youtu.be/xx-xZC9JtoM?t=191

3.
BoostFS = huge fast backup speed thanks to source de-duplication
For everyone!

BoostFS Live:

Data Domain 7.2 provides even faster BoostFS backups:

DD 7.2 increases the already super performance of BoostFS - - Real data from SQL backups:

4.
Recovery performance

Each recovery stream is split into multiple threads to speed up recovery!
As a result, even if we have Data Domain with a small number of disks, we achieve a big speed:

5.
Further optimization of Garbage Collection algorithms.

Data Domain provides huge performance – regardless if it performs internal processes or not. 
Thanks to this, it has over 50% market share:

How to set Data Domain cleanup parameters - live:

6.
Data Domain - algorithmic device:
https://youtu.be/m1XNy6IXzOo?t=924
focused on performance:
7.
Possibility to extend compliance for ever

8.
Data Domain allows for fast, frequent backups

9.
No visibility of source de-dup for production:


=====================
The video is recording for customers/partners discussion.
Thank you very much all that took place in this event live!
Thank you for time, discussion and... fun!!!

Performance and Security!
BackupRecoveryGuy


#datadomain #dd #7.2 #dd7.2 #backup #backupperformance #recovery #recoveryperformance #dataprotection #security #datasecurity #news #backupmedia #media #boostfs #boost #deduplication #de-dup


Wednesday, January 8, 2020

Ransomware attack - how can we recover?

Whatever we do in our life, it is always good to have Plan B.

What if my data are encrypted by ransomware?
Do I have Plan B?
How can I access my data?

What if I have backups that have no chance to be ransomwared/ removed?
What if I have a cyber bunker?
What if I have Cyber Recovery plan?
And... can it be with very attractive cost?


What backup/recovery solution can offer me in case of ransomware/hacker attack?
Why Plan B is important?
https://youtu.be/jtgm2WHpFPk?t=53

How can I lock against ransmoware/hacker?
How can I be sure that none can remove /change my backups.
Can I restore in case of ransomware/hacker attack.
https://youtu.be/jtgm2WHpFPk?t=885

Bunker in IT? - Why, When, How?
Can we do everything automatically?
Can we control our IT over ransomware?
Can we recover immediately?
https://youtu.be/jtgm2WHpFPk?t=1779

All methods to protect against ransomware/hacker
https://youtu.be/jtgm2WHpFPk?t=319

Hardening - let's remember about this simple approach
https://youtu.be/jtgm2WHpFPk?t=385

Data Domain Snapshots 
No cost, no additional space, no performance degradation method to have protection of our backups
https://youtu.be/jtgm2WHpFPk?t=461

Why source de-duplication increases my security?
https://youtu.be/jtgm2WHpFPk?t=612

--------------
We can protect ourselves against ransomware/hacker
We can have plan B
We can make it easy and automated...

Let's consider it...

--------------
Presentation about Cyber Recovery (the one used in video):
http://gurago.pl/s1/CyberRecovery.pdf


Only successful recoveries!
BackupRecoveryGuy




Monday, December 9, 2019

Why new Data Domain models? - DD6900 / DD9400 / DD9900 backup/recovery appliances

In September 2019 Dell announced 3 new Data Domain models (DD6900 / DD9400 / DD9900)
Shall we take under considerations new Data Domain models?

If so why?
What is the architecture?



Below is the summary of changes in new Data Domain models:
  • DD6900
  • DD9400
  • DD9900

Automated protection against ransomware / hacker.
Any backup performed on new Data Domain models is automatically protected for defined period.
Neither ransomware nor hacker can delete it.
How is it possible?
https://youtu.be/xx-xZC9JtoM?t=1169

Reducing disk space required for backups
New models require 10-30% less space for storing backups comparing to previous ones.
Wow! Can it be?
https://youtu.be/xx-xZC9JtoM?t=191

Starting even 64 Virtual Machines from new Data Domains with 60 000 IOps performance!
Hugh, can backup be faster than production?
https://youtu.be/xx-xZC9JtoM?t=961

Faster restores from new Data Domain

Capacity on demand
In new Data Domain models we can get more space but pay for the one that we use.
Details:

Faster internal components
Does it matter?

Scalability from 48 TB to 1 250 TB
Details:

Networking
100Gb Ethernet card is possible!

Very little space required Can you store 1.25PB in single rack?
https://youtu.be/xx-xZC9JtoM?t=1512

Monitoring and visualizing online all its components
Nice…

Upgrades
How can it move to new models?

--------------
New Data Domain models have a number new & exciting things.
It makes sense to have a closer look on them...

Presentation about new Data Domain models (the one used in video):
http://gurago.pl/s1/NewDataDomains_Detailed_DD6900_DD9400_DD9900.pdf

Only immediate recoveries!
BackupRecoveryGuy