Deprecated: Creation of dynamic property wpdb::$categories is deprecated in /home/garrens3/public_html/blog/wp-includes/wp-db.php on line 760
Deprecated: Creation of dynamic property wpdb::$post2cat is deprecated in /home/garrens3/public_html/blog/wp-includes/wp-db.php on line 760
Deprecated: Creation of dynamic property wpdb::$link2cat is deprecated in /home/garrens3/public_html/blog/wp-includes/wp-db.php on line 760
Deprecated: Using ${var} in strings is deprecated, use {$var} instead in /home/garrens3/public_html/blog/wp-includes/comment-template.php on line 1747
Deprecated: Optional parameter $term_id declared before required parameter $meta_value is implicitly treated as a required parameter in /home/garrens3/public_html/blog/wp-content/plugins/advanced-code-editor/advanced-code-editor.php on line 1927
Deprecated: Optional parameter $term_id declared before required parameter $meta_value is implicitly treated as a required parameter in /home/garrens3/public_html/blog/wp-content/plugins/advanced-code-editor/advanced-code-editor.php on line 1941
Deprecated: Optional parameter $term_id declared before required parameter $meta_key is implicitly treated as a required parameter in /home/garrens3/public_html/blog/wp-content/plugins/advanced-code-editor/advanced-code-editor.php on line 1956
Deprecated: Optional parameter $term_id declared before required parameter $key is implicitly treated as a required parameter in /home/garrens3/public_html/blog/wp-content/plugins/advanced-code-editor/advanced-code-editor.php on line 1970
Deprecated: Automatic conversion of false to array is deprecated in /home/garrens3/public_html/blog/wp-content/plugins/loginizer/init.php on line 250
Deprecated: Automatic conversion of false to array is deprecated in /home/garrens3/public_html/blog/wp-content/plugins/loginizer/init.php on line 265
Deprecated: Creation of dynamic property WP_Block_Type::$skip_inner_blocks is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-block-type.php on line 391
Deprecated: Creation of dynamic property WP_Block_Type::$skip_inner_blocks is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-block-type.php on line 391
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118
Deprecated: Creation of dynamic property WP_Term::$object_id is deprecated in /home/garrens3/public_html/blog/wp-includes/class-wp-term-query.php on line 1118 s3 – Garren's [Big] Data Blog
Often we log data in JSON, CSV or other text format to Amazon’s S3 as compressed files. This pattern is a) accessible and b) infinitely scalable by nature of being in S3 as common text files. However, there are some subtle but critical caveats that come with this pattern that can cause quite a bit… Continue reading→
Deprecated: Creation of dynamic property WP_Term::$cat_ID is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 378
Deprecated: Creation of dynamic property WP_Term::$category_count is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 379
Deprecated: Creation of dynamic property WP_Term::$category_description is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 380
Deprecated: Creation of dynamic property WP_Term::$cat_name is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 381
Deprecated: Creation of dynamic property WP_Term::$category_nicename is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 382
Deprecated: Creation of dynamic property WP_Term::$category_parent is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 383
Apache Spark supports many different data sources, such as the ubiquitous Comma Separated Value (CSV) format and web API friendly JavaScript Object Notation (JSON) format. A common format used primarily for big data analytical purposes is Apache Parquet. Parquet is a fast columnar data format that you can read more about in two of my… Continue reading→
Deprecated: Creation of dynamic property WP_Term::$cat_ID is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 378
Deprecated: Creation of dynamic property WP_Term::$category_count is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 379
Deprecated: Creation of dynamic property WP_Term::$category_description is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 380
Deprecated: Creation of dynamic property WP_Term::$cat_name is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 381
Deprecated: Creation of dynamic property WP_Term::$category_nicename is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 382
Deprecated: Creation of dynamic property WP_Term::$category_parent is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 383
Pre-requisites AWS S3 Hadoop AWS Jar AWS Java SDK Jar * Note: These AWS jars should not be necessary if you’re using Amazon EMR. Amazon Redshift JDBC Driver Spark-Redshift package * * The Spark-redshift package provided by Databricks is critical particularly if you wish to WRITE to Redshift, because it does bulk file operations instead… Continue reading→
Deprecated: Creation of dynamic property WP_Term::$cat_ID is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 378
Deprecated: Creation of dynamic property WP_Term::$category_count is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 379
Deprecated: Creation of dynamic property WP_Term::$category_description is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 380
Deprecated: Creation of dynamic property WP_Term::$cat_name is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 381
Deprecated: Creation of dynamic property WP_Term::$category_nicename is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 382
Deprecated: Creation of dynamic property WP_Term::$category_parent is deprecated in /home/garrens3/public_html/blog/wp-includes/category.php on line 383