Skip to content

v1.0.0
Compare
Choose a tag to compare
@JoshRosen JoshRosen released this 11 Jul 18:24
· 39 commits to master since this release
v1.0.0
6262705

This is the last planned major release of this library for Spark 1.x.

spark-redshift 1.x releases will remain compatible with Spark 1.4.x through 1.6.x, while spark-redshift 2.0.0+ will support only Spark 2.0.0+.

We will continue to fix minor bugs in 1.x maintenance releases but do not plan to add major new features in the 1.x line.

Bug Fixes:

  • Properly escape backslashes in queries passed to UNLOAD (#215 / #228).
  • Fix loss of sub-second precision when reading timestamps from Redshift (#214 / #227).
  • Fix a bug which led to incorrect results for queries that contained filters with date or timestamp literals (#152 / #156).
  • Fix a bug which broke the use of IAM instance profile credentials (#158 / #159).
  • Use MANIFEST to guard against eventually-consistent S3 bucket listing calls (#151).

Enhancements:

  • The Redshift username and password can now be specified as configuration options rather than being embedded in the URL (#132 / #162). This should fix connectivity issues for users whose Redshift passwords contained non-URL-safe characters.
  • Support for using IAM roles to authorize Redshift <-> S3 connections (#199 / #219).
  • Support for specifying column comments and encodings (#164, #172, #178).
  • The COPY statement issued against Redshift is now logged in order to make debugging easier (#196).
  • Documentation enhancements: #150, #163.
Assets 2
Loading