{"id":132277,"date":"2018-08-22T00:07:43","date_gmt":"2018-08-22T00:07:43","guid":{"rendered":"http:\/\/inchoo.net\/?p=32436"},"modified":"2018-08-22T00:07:43","modified_gmt":"2018-08-22T00:07:43","slug":"gdpr-compliant-magento-2-database-dump","status":"publish","type":"post","link":"https:\/\/www.sushilkumar.ind.in\/blog\/php\/gdpr-compliant-magento-2-database-dump\/","title":{"rendered":"GDPR compliant Magento 2 database dump"},"content":{"rendered":"

On May 25th, a data privacy law known as GDPR came into effect. It impacts the way companies collect and handle user data. In this article we will show you how to handle personal user data when creating database dumps in order to avoid potential GDPR penalties.<\/span><\/p>\n

What is GDPR?<\/h2>\n

In short, General Data Protection Regulation or GDPR is a set of rules that regulate how EU citizen data must be managed, empowering EU citizens with more control over their personal data. Organizations have to make sure that personal data is legally gathered, strictly managed and respected. Only the data that is needed should be collected and processed.<\/p>\n

You can find out what Inchoo did to prepare for GDPR<\/a> in our blog post by Toni Anicic<\/a>.<\/p>\n

Personal data in a Magento 2 project<\/h2>\n

Often when developing a Magento 2 project, data from a live Magento 2 website has to be used. Usually this means creating a copy of the website’s database structure and data, also known as a database dump. This database dump might include tables with personal user data such as names, addresses, emails, orders, invoices, etc. Having access to personal user data when it\u2019s not needed is considered bad practice as the data might get lost, stolen or become available to people that it\u2019s not intended for. Handling the user data this way can lead to significant GDPR penalties. Luckily, there is a way to avoid this by using a CLI tool called n98-<\/strong>magerun<\/b>.<\/p>\n

Netz98 magerun CLI tools<\/b><\/h2>\n

N98-magerun2<\/a> provides some handy tools to work with Magento 2 from the command line. Among the available tools that n98-magerun provides is the database dump tool.<\/p>\n

Installation<\/h3>\n

There are multiple ways to install n98-magerun2 in a Magento 2 project. We can download and install the phar file and make it executable or we can install the tool using Composer.<\/p>\n

Install the phar file<\/h4>\n

To download the latest stable n98-magerun2.phar<\/strong> file, run this command in your Magento 2 project:<\/p>\n

wget<\/span> https:\/\/<\/span>files.magerun.net\/<\/span>n98-magerun2.phar<\/code><\/pre>\n
Or if you prefer to use Curl:<\/p>\n
curl -O<\/span> https:\/\/<\/span>files.magerun.net\/<\/span>n98-magerun2.phar<\/code><\/pre>\n
Verify the download by comparing the SHA256 checksum with the one on the website:<\/p>\n
shasum -a256<\/span> n98-magerun2.phar<\/code><\/pre>\n
We can make the phar file executable:<\/p>\n
chmod<\/span> +x .\/<\/span>n98-magerun2.phar<\/code><\/pre>\n
It can now be called by using the PHP CLI interpreter:<\/p>\n
php n98-magerun2.phar {<\/span>command<\/span>}<\/span><\/code><\/pre>\n
Install with Composer<\/h4>\n
To install n98-magerun2 using Composer, inside a Magento 2 project run:<\/p>\n
composer require n98\/<\/span>magerun2<\/code><\/pre>\n
If there is an error, try:<\/p>\n
composer require --no-update<\/span> n98\/<\/span>magerun2\ncomposer update<\/code><\/pre>\n
N98-magerun2 commands are executed from the vendor\/bin\/<\/strong> folder. To verify the installation, run:<\/p>\n
.\/<\/span>vendor\/<\/span>bin\/<\/span>n98-magerun2 --version<\/span><\/code><\/pre>\n
Database dump
\n<\/b><\/h2>\n
The db:dump<\/strong> command is used to dump the project database. It uses mysqldump.<\/p>\n
.\/<\/span>vendor\/<\/span>bin\/<\/span>n98-magerun2 db:dump<\/code><\/pre>\n
This command will create a file containing the database structure and all of the data.<\/p>\n
Stripped database dump<\/h3>\n
The db:dump<\/b> command has a –strip<\/b> argument that can be used to exclude specific tables from the dump.<\/p>\n
.\/<\/span>vendor\/<\/span>bin\/<\/span>n98-magerun2 db:dump [<\/span>--strip]<\/span><\/code><\/pre>\n
Tables that we want to exclude can be added to the –strip<\/b> argument. Each of the tables should be separated by a space<\/b>. Wildcards like *<\/b> and ?<\/b> can be used in the table names to strip multiple tables.<\/p>\n
.\/<\/span>vendor\/<\/span>bin\/<\/span>n98-magerun2 db:dump --strip<\/span>=\u201dcustomer_address*<\/span> sales_invoice_*<\/span>\u201d<\/code><\/pre>\n
Table groups<\/h3>\n
Predefined table groups that start with @<\/strong> can also be used in the –strip<\/b> argument. These contain a list of tables that will be excluded from the dump when the table group is used in the –strip<\/b> argument.<\/p>\n
.\/<\/span>vendor\/<\/span>bin\/<\/span>n98-magerun2 db:dump --strip<\/span>=\u201d@<\/span>stripped\u201d<\/code><\/pre>\n
The table groups are predefined in the config.yaml<\/strong> file either in the vendor\/n98\/magerun2\/<\/strong> folder or in the n98-magerun2.phar<\/strong> package.<\/p>\n
Available table groups:<\/p>\n
@customers<\/span> customer_address*<\/span> customer_entity*<\/span> customer_grid_flat customer_log customer_visitor newsletter_subscriber product_alert*<\/span> vault_payment_token*<\/span> wishlist*<\/span>\n \n@search<\/span> catalogsearch_*<\/span>\n \n@sessions<\/span> core_session\n \n@log<\/span> log_url log_url_info log_visitor log_visitor_info log_visitor_online report_event report_compared_product_index report_viewed_*<\/span>\n \n@quotes<\/span> quote quote_*<\/span>\n \n@sales<\/span> sales_order sales_order_address sales_order_aggregated_created sales_order_aggregated_updated sales_order_grid sales_order_item sales_order_payment sales_order_status_history sales_order_tax sales_order_tax_item sales_invoice sales_invoice_*<\/span> sales_invoiced_*<\/span> sales_shipment sales_shipment_*<\/span> sales_shipping_*<\/span> sales_creditmemo sales_creditmemo_*<\/span> sales_recurring_*<\/span> sales_refunded_*<\/span> sales_payment_*<\/span> enterprise_sales_*<\/span> enterprise_customer_sales_*<\/span> sales_bestsellers_*<\/span> paypal_billing_agreement*<\/span> paypal_payment_transaction paypal_settlement_report*<\/span>\n \n@admin<\/span> admin*<\/span> authorization*<\/span>\n \n@trade<\/span> @customers<\/span> @sales<\/span> @quotes<\/span>\n \n@stripped<\/span> @log<\/span> @sessions<\/span>\n \n@development<\/span> @admin<\/span> @trade<\/span> @stripped<\/span> @search<\/span><\/code><\/pre>\n
The @development<\/strong> table group includes other predefined table groups that contain sensitive user data such as logs, sessions, trade data, admin users, orders, invoices, credit memos, quotes, etc. This table group should be used when personal user data is not needed.<\/p>\n
The @development<\/strong> table group should take care of all customer data for a default Magento 2 project, but in many cases, a Magento 2 project will contain modules that create their own data tables. For customer data contained in tables not defined by the default Magento 2 project installation, custom table groups should be defined.<\/p>\n
Custom table groups<\/h3>\n
In addition to the predefined table groups, custom table groups can also be defined. To define a custom table group, create a n98-magento2.yaml<\/strong> file inside the Magento 2 project app\/etc\/<\/strong> folder. The file should contain the following lines:<\/p>\n
# app\/etc\/n98-magerun2.yaml<\/span>\n# ...<\/span>\ncommands<\/span>: N98\\Magento\\Command\\Database\\DumpCommand<\/span>: table-groups<\/span>: - id<\/span>: <\/span>table_group_name description<\/span>: <\/span>table group description tables<\/span>: <\/span>space separated list of tables\n# ...<\/span><\/code><\/pre>\n
This will create a new table group @table_group_name<\/b> that can be used in the –strip<\/b> argument to exclude the data specified inside this group.<\/p>\n
This way we can strip all of the personal user data that we do not need, making sure that the database dump is GDPR compliant and that the personal user data is never available if not needed.<\/p>\n
The post GDPR compliant Magento 2 database dump<\/a> appeared first on Inchoo<\/a>.<\/p>\n
Click here for more informations about top website development services <\/a><\/h1>\n","protected":false},"excerpt":{"rendered":"
On May 25th, a data privacy law known as GDPR came into effect. It impacts the way companies collect and handle user data. In this article we will show you how to handle personal user data when creating database dumps in order to avoid potential GDPR penalties. What is GDPR? In short, General Data Protection …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false},"version":2}},"categories":[1121,1122,20,1123,19],"tags":[],"class_list":["post-132277","post","type-post","status-publish","format-standard","","category-database","category-gdpr","category-magento-2","category-magerun","category-php"],"jetpack_publicize_connections":[],"acf":[],"aioseo_notices":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p99pkJ-ypv","_links":{"self":[{"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/posts\/132277"}],"collection":[{"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/comments?post=132277"}],"version-history":[{"count":0,"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/posts\/132277\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/media?parent=132277"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/categories?post=132277"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sushilkumar.ind.in\/blog\/wp-json\/wp\/v2\/tags?post=132277"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}