-- Logs begin at Sat 2021-11-13 20:01:14 UTC, end at Sat 2021-11-13 22:42:34 UTC. -- Nov 13 20:55:09.042271 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Nov 13 20:55:12.457186 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=128900) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 13 20:55:12.457797 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=128900) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 13 20:55:12.842460 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_db.sqlalchemy.engines [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 20:55:13.059576 ncdv-master-1 cinder-volume[128900]: INFO cinder.rpc [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 13 20:55:13.063966 ncdv-master-1 cinder-volume[128900]: INFO cinder.rpc [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 13 20:55:13.071149 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_db.sqlalchemy.engines [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 20:55:13.133206 ncdv-master-1 cinder-volume[128900]: INFO cinder.volume.manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Determined volume DB was empty at startup. Nov 13 20:55:13.133801 ncdv-master-1 cinder-volume[128900]: DEBUG cinder.volume.manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=128900) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Nov 13 20:55:13.141344 ncdv-master-1 cinder-volume[128900]: INFO cinder.volume.manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 13 20:55:13.142121 ncdv-master-1 cinder-volume[128900]: WARNING stevedore.named [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 20:55:13.142544 ncdv-master-1 cinder-volume[128900]: WARNING castellan.key_manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 20:55:13.143636 ncdv-master-1 cinder-volume[128900]: WARNING cinder.keymgr.conf_key_mgr [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 20:55:13.164163 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_db.sqlalchemy.engines [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 20:55:13.169524 ncdv-master-1 cinder-volume[128900]: INFO cinder.rpc [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 13 20:55:13.173576 ncdv-master-1 cinder-volume[128900]: INFO cinder.rpc [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Nov 13 20:55:13.174269 ncdv-master-1 cinder-volume[128900]: WARNING stevedore.named [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 20:55:13.174675 ncdv-master-1 cinder-volume[128900]: WARNING castellan.key_manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 20:55:13.177694 ncdv-master-1 cinder-volume[128900]: INFO cinder.volume.manager [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Image-volume cache enabled for host ncdv-master-1@ceph. Nov 13 20:55:13.185083 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_db.sqlalchemy.engines [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128900) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 20:55:13.250892 ncdv-master-1 cinder-volume[128900]: INFO oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Starting 1 workers Nov 13 20:55:13.256254 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Started child 129109 {{(pid=128900) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 13 20:55:13.258172 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Full set of CONF: {{(pid=128900) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 13 20:55:13.258712 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ******************************************************************************** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 13 20:55:13.259149 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] Configuration options gathered from: {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 13 20:55:13.259936 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 13 20:55:13.260790 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 13 20:55:13.265615 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ================================================================================ {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 13 20:55:13.265615 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] allow_availability_zone_fallback = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.265615 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] allow_compression_on_image_upload = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.265909 ncdv-master-1 cinder-volume[129109]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] allowed_direct_url_schemes = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] api_rate_limit = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] auth_strategy = keystone {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] az_cache_duration = 3600 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_availability_zone = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.266413 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_host = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.267151 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.267896 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_stats_polling_interval = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.268441 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backup_api_class = cinder.backup.api.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.268977 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.269516 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backup_name_template = backup-%s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.270065 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backup_use_same_host = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.270604 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backup_use_temp_snapshot = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.271132 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] chap_password = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.271650 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] chap_username = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.272246 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.272969 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_internal_tenant_project_id = 5c62bfce2e1c42ff851da53cfbfff43b {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.273521 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_internal_tenant_user_id = 2ea30c0bd53c4192bb4cd197aa27e8d2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.274177 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cloned_volume_same_az = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.274680 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cluster = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.275206 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] compression_format = gzip {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.275785 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] compute_api_class = cinder.compute.nova.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.276351 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] config_dir = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.276938 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.277606 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] config_source = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.278113 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.278681 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] control_exchange = openstack {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.279231 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] debug = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.279738 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] default_availability_zone = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.280244 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] default_group_type = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.281105 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.283426 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] default_volume_type = ceph {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.284405 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_client_cert = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.285219 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_client_cert_key = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.286817 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_data_namespace = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.287632 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_ssl_cert_path = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.288264 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_ssl_cert_verify = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.289513 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] driver_use_ssl = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.290053 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] enable_force_upload = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] enable_new_services = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] enable_unsupported_driver = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] enabled_backends = ['ceph'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] enforce_multipath_for_image_xfer = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] filter_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.294858 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_api_insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.295385 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_api_servers = ['http://10.222.0.20/image'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.295385 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_api_ssl_compression = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.295385 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_ca_certificates_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.295630 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_catalog_info = image:glance:publicURL {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.296125 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.296624 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Starting volume driver RBDDriver (1.2.0) Nov 13 20:55:13.296930 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.297433 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.298101 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_num_retries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.298606 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] glance_request_timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.298715 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.299200 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] goodness_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.299735 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] graceful_shutdown_timeout = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.300253 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] group_api_class = cinder.group.api.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.300707 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] host = ncdv-master-1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.301227 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iet_conf = /etc/iet/ietd.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.301754 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_compress_on_upload = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.302244 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_conversion_address_space_limit = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.302751 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_conversion_cpu_limit = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.304082 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.305258 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_upload_use_cinder_backend = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.305762 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_upload_use_internal_tenant = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.306277 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_volume_cache_enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.306777 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_volume_cache_max_count = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.307284 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] image_volume_cache_max_size_gb = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.307792 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] init_host_max_objects_retrieval = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.308446 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] instance_format = [instance: %(uuid)s] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.308998 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.309536 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iscsi_iotype = fileio {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.310068 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iscsi_secondary_ip_addresses = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.310595 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iscsi_target_flags = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.311103 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iscsi_write_cache = on {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.311607 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iser_helper = tgtadm {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.312375 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iser_ip_address = 10.222.0.20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.312972 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iser_port = 3260 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_config_append = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_dir = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_options = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317232 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_rotate_interval = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317781 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_rotate_interval_type = days {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317781 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] log_rotation_type = none {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.317781 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.318070 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.318546 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.319513 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.319800 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.320178 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] max_age = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.320525 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] max_logfile_count = 30 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.320921 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] max_logfile_size_mb = 200 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.321305 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] max_over_subscription_ratio = 20.0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.321697 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] message_reap_interval = 86400 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.322039 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] message_ttl = 2592000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.322421 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] migration_create_volume_timeout_secs = 300 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.322766 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] monkey_patch = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.323117 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] monkey_patch_modules = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.323421 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] my_ip = 10.222.0.20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.323787 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] no_snapshot_gb_quota = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.324356 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] num_iser_scan_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.324900 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] num_shell_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.327574 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] num_volume_device_scan_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.328117 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] nvmet_ns_id = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.328615 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] nvmet_port_id = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.329078 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_max_limit = 1000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.329452 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_ext_list = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.329876 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.330242 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_listen = 0.0.0.0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.330617 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_listen_port = 8776 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.330968 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_use_ssl = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.331328 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] osapi_volume_workers = 2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.331715 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] per_volume_size_limit = -1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.332034 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] periodic_fuzzy_delay = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.332406 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] periodic_interval = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.332790 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] public_endpoint = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.333214 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] publish_errors = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.333581 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_backup_gigabytes = 1000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.333965 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_backups = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.334501 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_consistencygroups = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.335791 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.336502 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_gigabytes = 1000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.337205 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_groups = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.337739 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_snapshots = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.338264 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] quota_volumes = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.338881 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] rate_limit_burst = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.339385 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] rate_limit_except_level = CRITICAL {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.339887 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] rate_limit_interval = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.340396 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] reinit_driver_count = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.341021 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] replication_device = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.341859 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] report_discard_supported = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.342364 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] report_interval = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.343176 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] reservation_clean_interval = 86400 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.343632 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] reservation_expire = 86400 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.344503 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] reserved_percentage = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.345074 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.345581 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.346266 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] rpc_response_timeout = 120 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.346635 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] run_external_periodic_tasks = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.346999 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.347379 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] scst_target_driver = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.347746 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] scst_target_iqn_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.348040 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_down_time = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.348422 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] snapshot_name_template = snapshot-%s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.350424 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] snapshot_same_host = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.350800 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] split_loggers = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.351102 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] state_path = /opt/stack/data/cinder {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.351477 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] storage_availability_zone = nova {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.351845 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] storage_protocol = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.352215 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] syslog_log_facility = LOG_USER {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.352587 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] target_helper = lioadm {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.353095 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] target_ip_address = 10.222.0.20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.353454 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] target_port = 3260 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.355641 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.356315 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] target_protocol = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.356706 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] trace_flags = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.357096 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] transfer_api_class = cinder.transfer.api.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.357469 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] transport_url = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.357834 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] until_refresh = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.358209 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_chap_auth = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.358499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.358618 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_default_quota_class = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.359321 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_eventlog = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.359681 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_journal = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.360036 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_json = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.364243 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_multipath_for_image_xfer = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.364887 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_stderr = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.365266 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] use_syslog = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.366371 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] verify_glance_signatures = enabled {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.366750 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_api_class = cinder.volume.api.API {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.367728 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_backend_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.368147 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_clear = zero {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.368510 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_clear_ionice = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.368918 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_clear_size = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.369446 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.369815 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_copy_bps_limit = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.370169 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_dd_blocksize = 1M {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.370704 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.371212 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_name_template = volume-%s {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.371710 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_service_inithost_offload = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.372243 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volume_usage_audit_period = month {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.372870 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.373404 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] watch_log_file = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.373908 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] zoning_mode = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 13 20:55:13.374550 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.375104 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.enforce_new_defaults = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.375494 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.enforce_scope = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.375893 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.policy_default_rule = default {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.376328 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.376803 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.policy_file = policy.yaml {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.377196 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.377549 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.377904 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.378262 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.378609 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.379033 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_concurrency.disable_process_locking = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.379449 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.379883 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.admin_password = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.380243 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.380585 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.admin_token = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.380968 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.admin_user = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.381915 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_admin_prefix = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.382278 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.382647 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_port = 35357 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.383036 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_protocol = https {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.383496 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_section = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.383832 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_type = password {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.384197 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_uri = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.384558 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.auth_version = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.385163 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.cache = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.385530 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.385904 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.386254 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.delay_auth_decision = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.386635 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.386973 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.http_connect_timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.387321 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.387665 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.identity_uri = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.388012 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.include_service_catalog = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.388603 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.388993 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.interface = public {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.389336 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.389869 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.390056 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.390559 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.391061 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.391569 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.392132 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.392662 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.393032 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.393448 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.393790 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.region_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.394161 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.394516 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.service_token_roles_required = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.394863 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.service_type = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.395349 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.token_cache_time = 300 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.395730 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.396203 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.backend = dogpile.cache.null {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.396576 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.backend_argument = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.397052 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.config_prefix = cache.oslo {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.397537 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.debug_cache_backend = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.397912 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.398283 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.expiration_time = 600 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.398644 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_dead_retry = 300 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.398994 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.399346 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.399696 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_pool_maxsize = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.400053 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.400439 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.400953 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.memcache_socket_timeout = 1.0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.401304 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.proxies = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.401671 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.tls_allowed_ciphers = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.402006 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.tls_cafile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.402344 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.tls_certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.402709 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.tls_enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.403043 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cache.tls_keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.403425 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] coordination.backend_url = etcd3+http://10.222.0.20:2379 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.403854 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.backend = sqlalchemy {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.404445 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.connection = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.404567 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.connection_debug = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.405217 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.connection_parameters = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.405727 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.connection_recycle_time = 3600 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.406095 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.connection_trace = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.406462 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.db_inc_retry_interval = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.406819 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.db_max_retries = 20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.407163 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.db_max_retry_interval = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.407515 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.db_retry_interval = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.407883 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.max_overflow = 50 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.408227 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.max_pool_size = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.408583 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.max_retries = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.409834 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.mysql_enable_ndb = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.410340 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.410834 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.pool_timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.411335 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.retry_interval = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.411847 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.slave_connection = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.413962 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.sqlite_synchronous = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.413962 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] database.use_db_reconnect = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.414297 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.414649 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.415011 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.417549 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.417549 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.418051 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.connection_string = messaging:// {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.418353 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.419253 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.es_doc_type = notification {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.419253 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.es_scroll_size = 10000 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.419451 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.es_scroll_time = 2m {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.419756 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.filter_error_trace = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.420111 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.hmac_keys = SECRET_KEY {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.420471 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.sentinel_service_name = mymaster {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.422050 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.socket_timeout = 0.1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.422414 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] profiler.trace_sqlalchemy = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.422841 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.capabilities = [21] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.423251 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.group = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.423575 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.helper_command = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.424004 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.424363 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.424794 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] privsep_osbrick.user = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.425188 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.425528 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.group = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.425867 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.helper_command = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.426216 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.426560 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.426654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.427017 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] cinder_sys_admin.user = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.427406 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.auth_section = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.427754 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.auth_type = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.428163 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.cafile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.428519 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.428913 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.collect_timing = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.429416 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.430444 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.430960 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.send_service_user_token = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.431455 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.split_loggers = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.431943 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] service_user.timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.432492 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.backend_availability_zone = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.432928 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.433281 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.433643 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.chap_password = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.434002 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.chap_username = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.434359 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.434712 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.435063 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.435407 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_client_cert = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.435746 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_client_cert_key = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.436103 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_data_namespace = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.436439 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.436819 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.437608 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.driver_use_ssl = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.437608 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.enable_deferred_deletion = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.438106 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.enable_unsupported_driver = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.439235 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.439786 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.extra_capabilities = {} {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.440140 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.filter_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.440483 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.goodness_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.440873 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.441301 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.441702 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.443083 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.443083 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.443285 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.443611 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iscsi_iotype = fileio {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.444528 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.444913 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iscsi_target_flags = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.445274 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iscsi_write_cache = on {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.446644 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iser_helper = tgtadm {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.447225 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iser_ip_address = 10.222.0.20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.447582 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iser_port = 3260 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.447971 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.448335 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.448682 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.449819 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.num_shell_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.450334 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.451582 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.451582 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.nvmet_port_id = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.451582 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.452775 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rados_connection_interval = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.453297 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rados_connection_retries = 3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.453675 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_ceph_conf = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.454043 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.454395 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.454764 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.455136 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.456386 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_pool = rbd {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.456763 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_secret_uuid = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.457276 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.458236 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.rbd_user = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.458603 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.458958 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.replication_device = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.459386 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.report_discard_supported = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.459750 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.460104 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.reserved_percentage = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.460466 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.scst_target_driver = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.461637 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.scst_target_iqn_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.462012 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.storage_protocol = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.462367 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.462754 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.target_helper = tgtadm {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.463229 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.target_ip_address = 10.222.0.20 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.463581 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.target_port = 3260 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.463977 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.464337 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.target_protocol = iscsi {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.464708 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.trace_flags = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.465843 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.unique_fqdn_network = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.466434 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.use_chap_auth = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.466547 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.466881 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_backend_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.467244 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_clear = zero {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.467587 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_clear_ionice = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.467931 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_clear_size = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.468291 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.468659 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.469188 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.469599 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.470065 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.470459 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_reports.file_event_handler = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.470838 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.471205 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_reports.log_dir = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.471600 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.backend_availability_zone = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.471946 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.backend_host = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.472291 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.backend_native_threads_pool_size = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.472636 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.backup_use_temp_snapshot = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.473026 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.chap_password = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.473371 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.chap_username = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.473740 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.chiscsi_conf = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.474083 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.deferred_deletion_delay = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.474422 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.deferred_deletion_purge_interval = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.474753 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_client_cert = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.475845 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_client_cert_key = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.476202 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_data_namespace = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.476546 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_ssl_cert_path = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.476916 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_ssl_cert_verify = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.477255 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.driver_use_ssl = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.477602 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.enable_deferred_deletion = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.478013 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.enable_unsupported_driver = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.478306 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.478651 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.extra_capabilities = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.478989 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.filter_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.479328 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.goodness_function = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.479675 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iet_conf = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.480015 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.image_upload_use_cinder_backend = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.480359 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.image_upload_use_internal_tenant = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.480773 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.image_volume_cache_enabled = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.481278 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.image_volume_cache_max_count = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.481618 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.481973 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iscsi_iotype = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.482316 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.482657 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iscsi_target_flags = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.482998 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iscsi_write_cache = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.483349 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iser_helper = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.483942 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iser_ip_address = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.484295 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iser_port = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.iser_target_prefix = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.max_over_subscription_ratio = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.num_iser_scan_tries = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.num_shell_tries = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.num_volume_device_scan_tries = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486360 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.nvmet_ns_id = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.486780 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.nvmet_port_id = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.487024 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rados_connect_timeout = -1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.487519 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rados_connection_interval = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.487864 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rados_connection_retries = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.488237 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.488585 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_cluster_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.489797 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.490171 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.490577 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_max_clone_depth = 5 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.490952 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_pool = volumes {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.491314 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_secret_uuid = 575ec9f0-064f-427c-bf35-72b83580d1d1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.491678 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_store_chunk_size = 4 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.492119 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.rbd_user = cinder {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.492457 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.replication_connect_timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.492846 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.replication_device = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.493191 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.report_discard_supported = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.493538 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.report_dynamic_total_capacity = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.493881 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.reserved_percentage = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.494237 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.scst_target_driver = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.494562 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.scst_target_iqn_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.494897 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.storage_protocol = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.495238 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.495578 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.target_helper = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.495916 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.target_ip_address = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.496250 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.target_port = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.496585 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.target_prefix = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.496982 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.target_protocol = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.497321 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.trace_flags = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.497659 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.unique_fqdn_network = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.497994 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.use_chap_auth = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.498327 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.use_multipath_for_image_xfer = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.498698 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_backend_name = ceph {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.499029 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_clear = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.500972 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_clear_ionice = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.501540 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_clear_size = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.502069 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.502565 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_copy_bps_limit = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.503073 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_dd_blocksize = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.503588 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.504090 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ceph.volumes_dir = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.504724 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.505311 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.505698 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.507688 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.508231 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.508616 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.509732 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.510252 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.510760 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.511085 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.driver [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Driver hasn't implemented _init_vendor_properties() Nov 13 20:55:13.511411 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.511785 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.driver [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:fdaf7799-955e-42b6-8e36-a87651fedaa0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129109) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Nov 13 20:55:13.512137 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.512640 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.513206 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.513705 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.514217 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.514739 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.515250 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.515749 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.516256 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.516822 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.517344 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.517900 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.ssl = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.518427 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.518800 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.519178 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.519612 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_rabbit.ssl_version = {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.519937 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_notifications.driver = [] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.520317 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_notifications.retry = -1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.521164 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.521164 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] oslo_messaging_notifications.transport_url = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.521462 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.521780 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] key_manager.fixed_key = **** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.522240 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.522602 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.barbican_api_version = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.523785 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.barbican_endpoint = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.523785 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.barbican_endpoint_type = public {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.523785 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.barbican_region_name = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.524021 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.cafile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.524362 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.524763 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.collect_timing = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.525114 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.525455 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.526093 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.number_of_retries = 60 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.526212 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.retry_delay = 1 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.526487 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.send_service_user_token = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.526986 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.split_loggers = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.527488 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.527998 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.verify_ssl = True {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.528483 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican.verify_ssl_path = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.529017 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.auth_section = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.529527 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.auth_type = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.529860 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.cafile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.530206 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.530553 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.collect_timing = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.530896 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.531260 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.531602 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.split_loggers = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.532484 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] barbican_service_user.timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.532484 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.approle_role_id = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.532647 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.approle_secret_id = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.533803 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.cafile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.533803 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.certfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.533803 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.collect_timing = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.534035 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.insecure = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.534306 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.keyfile = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.534782 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.kv_mountpoint = secret {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.535300 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.kv_version = 2 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.535642 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.namespace = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.535990 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.root_token_id = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.536332 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.split_loggers = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.536786 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.ssl_ca_crt_file = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.537056 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.timeout = None {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.537960 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.use_ssl = False {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.538153 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-d3f29078-0052-45c5-b787-395388f39404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 20:55:13.538322 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 13 20:55:13.538767 ncdv-master-1 cinder-volume[128900]: DEBUG oslo_service.service [None req-689800f8-abae-48a0-8332-b3c3d7d2ab32 None None] ******************************************************************************** {{(pid=128900) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 13 20:55:13.575326 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.db.sqlalchemy.api [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Building query based on filter {{(pid=129109) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3141}} Nov 13 20:55:13.594354 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=129109) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Nov 13 20:55:13.601309 ncdv-master-1 cinder-volume[129109]: INFO cinder.keymgr.migration [None req-54898987-aeea-4902-8431-490ed1759c38 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 13 20:55:13.608212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.649019 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.679206 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 20:55:13.712038 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Driver initialization completed successfully. Nov 13 20:55:13.722740 ncdv-master-1 cinder-volume[129109]: INFO cinder.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Initiating service 3 cleanup Nov 13 20:55:13.729272 ncdv-master-1 cinder-volume[129109]: INFO cinder.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Service 3 cleanup completed. Nov 13 20:55:13.736198 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.service [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Creating RPC server for service cinder-volume {{(pid=129109) start /opt/stack/cinder/cinder/service.py:231}} Nov 13 20:55:13.738310 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.service [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=129109) start /opt/stack/cinder/cinder/service.py:237}} Nov 13 20:55:13.811920 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Nov 13 20:55:13.812968 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:13.841488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d3f29078-0052-45c5-b787-395388f39404 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:55:14.043018 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d3f29078-0052-45c5-b787-395388f39404 None None] Driver post RPC initialization completed successfully. Nov 13 20:56:18.046098 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 20:56:18.046945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:56:18.069913 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:56:18.098948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 20:57:18.044425 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 20:57:18.045160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:57:18.067462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:57:18.090970 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 20:58:18.046054 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 20:58:18.047208 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:58:18.068562 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:58:18.090662 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 20:59:18.045432 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 20:59:18.046104 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:59:18.066436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 20:59:18.087624 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:00:18.042384 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:00:18.043091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:00:18.064123 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:00:18.085132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:01:18.040319 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:01:18.041042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:01:18.061345 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:01:18.084322 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:02:18.038826 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:02:18.039509 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:02:18.063123 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:02:18.151206 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:04:18.038132 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:04:18.038842 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:04:18.060539 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:04:18.082345 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:05:18.038018 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:05:18.039983 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:05:18.109016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:05:18.176769 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:06:18.034391 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:06:18.037562 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:06:18.123617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:06:18.185070 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:06:36.012177 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:06:36.031110 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:06:36.047590 ncdv-master-1 cinder-volume[129109]: INFO cinder.rpc [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Nov 13 21:06:36.056431 ncdv-master-1 cinder-volume[129109]: INFO cinder.rpc [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Nov 13 21:06:36.068132 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:06:36.068132 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:06:36.122676 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (80081b58-03e0-45ec-98ab-6215cc40c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:06:36.129436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a480223-1910-4214-a5a3-d9a47595c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:36.137548 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:06:36.209159 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a480223-1910-4214-a5a3-d9a47595c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-226227986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1508602e-52cb-4821-8d5b-54dad4ad2b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9cacff30fd4af19035b88fec319120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:06:36Z,use_quota=True,user_id='ef90efb6f8fd4bca86786e662f9d332e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:36.212007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94a880d-a31e-454b-a546-d3250cdd3f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:36.214120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94a880d-a31e-454b-a546-d3250cdd3f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:36.216637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b634fbb2-9f36-4df2-b562-64a0a92874fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:36.222304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b634fbb2-9f36-4df2-b562-64a0a92874fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1508602e-52cb-4821-8d5b-54dad4ad2b04', 'volume_name': 'volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:36.222948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07d0c2e-ed4b-443d-a2e5-d583b8d457bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:36.225359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b07d0c2e-ed4b-443d-a2e5-d583b8d457bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:36.243666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c9d3ff-5432-4ee1-ad2c-f986c1ff1ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:36.247180 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume 1508602e-52cb-4821-8d5b-54dad4ad2b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'volume_size': 1} Nov 13 21:06:36.248769 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] creating volume 'volume-1508602e-52cb-4821-8d5b-54dad4ad2b04' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:06:36.251006 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:06:37.111672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:06:37.113065 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:06:37.115518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c9d3ff-5432-4ee1-ad2c-f986c1ff1ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:37.119796 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffadf7-fd4b-4615-b5d3-13c5a94c2a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:37.189588 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-1508602e-52cb-4821-8d5b-54dad4ad2b04 (1508602e-52cb-4821-8d5b-54dad4ad2b04): created successfully Nov 13 21:06:37.207216 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfffadf7-fd4b-4615-b5d3-13c5a94c2a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:37.212408 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (80081b58-03e0-45ec-98ab-6215cc40c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:06:37.355069 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a0be70d0-cfb0-45a3-83e9-444c63603780 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created volume successfully. Nov 13 21:06:40.281892 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-3cc08c70-8f5b-4cf5-aab0-626f3646d815 req-c26bff9d-a8b8-4646-a84d-c634bb8cb0b3 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:06:41.145398 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-3cc08c70-8f5b-4cf5-aab0-626f3646d815 req-c26bff9d-a8b8-4646-a84d-c634bb8cb0b3 tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.863s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:06:41.146146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3cc08c70-8f5b-4cf5-aab0-626f3646d815 req-c26bff9d-a8b8-4646-a84d-c634bb8cb0b3 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '1508602e-52cb-4821-8d5b-54dad4ad2b04', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:06:41.256464 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-3cc08c70-8f5b-4cf5-aab0-626f3646d815 req-c26bff9d-a8b8-4646-a84d-c634bb8cb0b3 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Connection info returned from driver {'name': 'volumes/volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1508602e-52cb-4821-8d5b-54dad4ad2b04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8cf49730-cf71-4eb4-b6d6-73b784d541da'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:06:41.515185 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-3cc08c70-8f5b-4cf5-aab0-626f3646d815 req-c26bff9d-a8b8-4646-a84d-c634bb8cb0b3 tempest-LiveAutoBlockMigrationV225Test-941742021 None] attachment_update completed successfully. Nov 13 21:06:47.713911 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:06:47.717596 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:06:47.718253 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:06:47.746249 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Flow 'volume_create_manager' (a52f5e7f-24d8-4fef-8c6c-d3eaadbb1c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:06:47.760634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4314b6b5-967c-4236-a856-6a4c25ed1189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:47.770255 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:06:47.786380 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4314b6b5-967c-4236-a856-6a4c25ed1189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1166070238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a28c0d37-ba75-45b4-92a6-c531bf435b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d955549db8436198ccc9342b455243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:06:47Z,use_quota=True,user_id='ef55c44b96cd490ebdadf9e89596e472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:47.789658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb220009-91ee-4f29-9498-810a54ea3d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:47.791762 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb220009-91ee-4f29-9498-810a54ea3d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:47.794281 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd4d87c-d3dc-4b8a-9ca8-d5d2d279be81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:47.796451 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd4d87c-d3dc-4b8a-9ca8-d5d2d279be81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'volume_name': 'volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:47.798780 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5569a071-ef8a-49d0-9d08-dc236abe1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:47.800974 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5569a071-ef8a-49d0-9d08-dc236abe1e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:47.803156 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a568a6-5daf-41c8-91db-4812c0c526d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:47.804676 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Volume a28c0d37-ba75-45b4-92a6-c531bf435b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'volume_size': 1} Nov 13 21:06:47.808620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] creating volume 'volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:06:47.808620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:06:48.690266 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:06:48.690644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:06:48.692620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a568a6-5daf-41c8-91db-4812c0c526d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:48.695384 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b9a21f-27c7-46bf-9f5e-0947fc75e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:06:48.851273 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Volume volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b (a28c0d37-ba75-45b4-92a6-c531bf435b2b): created successfully Nov 13 21:06:48.853483 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b9a21f-27c7-46bf-9f5e-0947fc75e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:06:48.856526 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Flow 'volume_create_manager' (a52f5e7f-24d8-4fef-8c6c-d3eaadbb1c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:06:48.953890 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fd6101ba-24ad-404a-8a26-675a1aca7fe1 tempest-LiveMigrationTest-716427780 None] Created volume successfully. Nov 13 21:06:52.101976 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-4e537759-5332-4322-8b62-5c8b76da7e70 req-8135de9a-e4e6-42a7-bbbc-20e300748f95 tempest-LiveMigrationTest-716427780 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:06:53.206367 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-4e537759-5332-4322-8b62-5c8b76da7e70 req-8135de9a-e4e6-42a7-bbbc-20e300748f95 tempest-LiveMigrationTest-716427780 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.106s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:06:53.208399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-4e537759-5332-4322-8b62-5c8b76da7e70 req-8135de9a-e4e6-42a7-bbbc-20e300748f95 tempest-LiveMigrationTest-716427780 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:06:53.313064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4e537759-5332-4322-8b62-5c8b76da7e70 req-8135de9a-e4e6-42a7-bbbc-20e300748f95 tempest-LiveMigrationTest-716427780 None] Connection info returned from driver {'name': 'volumes/volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c384899d-e9a2-4308-b5d9-547a2277cbba'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:06:53.555916 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-4e537759-5332-4322-8b62-5c8b76da7e70 req-8135de9a-e4e6-42a7-bbbc-20e300748f95 tempest-LiveMigrationTest-716427780 None] attachment_update completed successfully. Nov 13 21:06:54.513461 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-9eb1c366-afa8-4fb8-ba26-8ee8b09553cd tempest-LiveAutoBlockMigrationV225Test-281244860 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:06:55.321531 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-9eb1c366-afa8-4fb8-ba26-8ee8b09553cd tempest-LiveAutoBlockMigrationV225Test-281244860 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.808s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:06:55.322319 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-9eb1c366-afa8-4fb8-ba26-8ee8b09553cd tempest-LiveAutoBlockMigrationV225Test-281244860 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '1508602e-52cb-4821-8d5b-54dad4ad2b04', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:06:55.441254 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-9eb1c366-afa8-4fb8-ba26-8ee8b09553cd tempest-LiveAutoBlockMigrationV225Test-281244860 None] Connection info returned from driver {'name': 'volumes/volume-1508602e-52cb-4821-8d5b-54dad4ad2b04', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1508602e-52cb-4821-8d5b-54dad4ad2b04', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f7470a30-e5f9-4bc8-a82e-19994ad2ef24'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:06:55.633883 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-9eb1c366-afa8-4fb8-ba26-8ee8b09553cd tempest-LiveAutoBlockMigrationV225Test-281244860 None] attachment_update completed successfully. Nov 13 21:07:05.071619 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-d65712bc-1e17-477a-9d0e-c1138bdc3888 tempest-LiveMigrationTest-637255377 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:05.891426 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-d65712bc-1e17-477a-9d0e-c1138bdc3888 tempest-LiveMigrationTest-637255377 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.820s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:05.892200 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-d65712bc-1e17-477a-9d0e-c1138bdc3888 tempest-LiveMigrationTest-637255377 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:07:06.382415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-d65712bc-1e17-477a-9d0e-c1138bdc3888 tempest-LiveMigrationTest-637255377 None] Connection info returned from driver {'name': 'volumes/volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a28c0d37-ba75-45b4-92a6-c531bf435b2b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9ab74418-8d6f-417e-826f-e9e03da5a9d6'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:07:06.567029 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-d65712bc-1e17-477a-9d0e-c1138bdc3888 tempest-LiveMigrationTest-637255377 None] attachment_update completed successfully. Nov 13 21:07:11.064207 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-48025f5b-2cff-45cc-b638-b830d83b3a92 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Terminate volume connection completed successfully. Nov 13 21:07:11.065049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-61e359e0-c0eb-4ee4-8c60-a7b5896b7f96 req-48025f5b-2cff-45cc-b638-b830d83b3a92 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Deleting attachment 8cf49730-cf71-4eb4-b6d6-73b784d541da. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:07:18.031018 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:07:18.032000 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:07:18.112352 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:07:18.178401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:07:19.611281 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a2159385-7f2e-4149-9aa1-fe7d3115c899 req-20fb36c2-99f3-45bc-b245-5d3dd1028cbf tempest-LiveAutoBlockMigrationV225Test-941742021 None] Terminate volume connection completed successfully. Nov 13 21:07:19.612483 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-a2159385-7f2e-4149-9aa1-fe7d3115c899 req-20fb36c2-99f3-45bc-b245-5d3dd1028cbf tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deleting attachment f7470a30-e5f9-4bc8-a82e-19994ad2ef24. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:07:21.256821 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-829482b0-1bca-47f5-8eb2-781eef90ed85 tempest-LiveMigrationTest-637255377 None] Terminate volume connection completed successfully. Nov 13 21:07:21.257585 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-ae3618fc-a4cb-4f0c-9e00-6112e6409b50 req-829482b0-1bca-47f5-8eb2-781eef90ed85 tempest-LiveMigrationTest-637255377 None] Deleting attachment c384899d-e9a2-4308-b5d9-547a2277cbba. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:07:21.564941 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:07:21.564941 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:07:21.564941 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:07:21.584133 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (c93ad58a-1f44-41f3-bf34-58b48bccb0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:07:21.588333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bba9fb-d44e-4593-9a76-3c11780231fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:21.595066 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:07:21.609765 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bba9fb-d44e-4593-9a76-3c11780231fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-699397073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=18c32b32-209d-450d-8539-a9709a62ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c9cacff30fd4af19035b88fec319120',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:07:21Z,use_quota=True,user_id='ef90efb6f8fd4bca86786e662f9d332e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:21.612632 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc2f4b8-814c-4ebc-b47a-813717c21522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:21.614983 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc2f4b8-814c-4ebc-b47a-813717c21522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:21.618336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580133e-dd31-449e-a767-9afb628d3117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:21.743314 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1580133e-dd31-449e-a767-9afb628d3117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '18c32b32-209d-450d-8539-a9709a62ccee', 'volume_name': 'volume-18c32b32-209d-450d-8539-a9709a62ccee', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:21.746067 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27bf34-47ce-4b7e-9ba3-5c93c6e2105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:21.749398 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c27bf34-47ce-4b7e-9ba3-5c93c6e2105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:21.752382 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8545a468-b243-4546-9fb3-cf9db777fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:21.753745 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume 18c32b32-209d-450d-8539-a9709a62ccee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-18c32b32-209d-450d-8539-a9709a62ccee', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:07:21.754875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Cloning 18c32b32-209d-450d-8539-a9709a62ccee from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:07:21.775706 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:07:21.781825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Preparing cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Nov 13 21:07:21.783334 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:07:28.056318 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-bc747062-8c56-4ece-8790-76f44859e26b req-1987cd8b-c475-450e-945b-f7beeb7ff306 tempest-LiveMigrationTest-716427780 None] Terminate volume connection completed successfully. Nov 13 21:07:28.057037 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-bc747062-8c56-4ece-8790-76f44859e26b req-1987cd8b-c475-450e-945b-f7beeb7ff306 tempest-LiveMigrationTest-716427780 None] Deleting attachment 9ab74418-8d6f-417e-826f-e9e03da5a9d6. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:07:31.036646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:07:31.046208 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:07:31.046739 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:07:31.071493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Flow 'volume_create_manager' (3235527b-f7d3-45c2-812b-df7a58756a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:07:31.077508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a06cfe3-ab50-49ac-a837-20332df7e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:31.086489 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:07:31.114129 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a06cfe3-ab50-49ac-a837-20332df7e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-158501290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eed44fc1-bbe1-4cab-a386-16dcc708610e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d955549db8436198ccc9342b455243',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:07:31Z,use_quota=True,user_id='ef55c44b96cd490ebdadf9e89596e472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:31.120309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12344802-a89f-47bb-9714-f03158a2c35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:31.123052 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12344802-a89f-47bb-9714-f03158a2c35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:31.125570 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba630df-ba9e-487f-8117-537fd9a38108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:31.262649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba630df-ba9e-487f-8117-537fd9a38108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eed44fc1-bbe1-4cab-a386-16dcc708610e', 'volume_name': 'volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:31.265635 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2ed02-0387-4b83-ac4f-6d4574d76384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:31.267858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d2ed02-0387-4b83-ac4f-6d4574d76384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:07:31.270127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429a783b-00d2-4527-b4fa-0f9710420b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:07:31.271868 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Volume eed44fc1-bbe1-4cab-a386-16dcc708610e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:07:31.272153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Cloning eed44fc1-bbe1-4cab-a386-16dcc708610e from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:07:37.259143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph, size 616.00 MB, duration 15.47 sec {{(pid=129109) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Nov 13 21:07:37.260009 ncdv-master-1 cinder-volume[129109]: INFO cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Image download 616.00 MB at 39.82 MB/s Nov 13 21:07:37.297108 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:37.395939 ncdv-master-1 sudo[139422]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph Nov 13 21:07:37.396883 ncdv-master-1 sudo[139422]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:38.198294 ncdv-master-1 sudo[139422]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:38.200405 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph" returned: 0 in 0.903s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:38.204992 ncdv-master-1 cinder-volume[129109]: WARNING py.warnings [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 13 21:07:38.204992 ncdv-master-1 cinder-volume[129109]: debtcollector.deprecate( Nov 13 21:07:38.204992 ncdv-master-1 cinder-volume[129109]: Nov 13 21:07:38.210801 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Temporary image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 is fetched for user ef90efb6f8fd4bca86786e662f9d332e. {{(pid=129109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Nov 13 21:07:38.467816 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:38.569176 ncdv-master-1 sudo[139428]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph Nov 13 21:07:38.569973 ncdv-master-1 sudo[139428]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:39.149161 ncdv-master-1 sudo[139428]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:39.152288 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph" returned: 0 in 0.684s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:39.156889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] creating volume 'volume-18c32b32-209d-450d-8539-a9709a62ccee' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:07:39.156889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:07:39.914946 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:07:39.915798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:07:40.094313 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Attempting download of 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 ((None, None)) to volume 18c32b32-209d-450d-8539-a9709a62ccee. {{(pid=129109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Nov 13 21:07:40.153745 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_3lvad20d {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:40.293422 ncdv-master-1 sudo[139457]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_3lvad20d Nov 13 21:07:40.295609 ncdv-master-1 sudo[139457]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:40.913524 ncdv-master-1 sudo[139457]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:40.915920 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_3lvad20d" returned: 0 in 0.762s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:40.921730 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:41.097397 ncdv-master-1 sudo[139462]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph Nov 13 21:07:41.098219 ncdv-master-1 sudo[139462]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:41.984448 ncdv-master-1 sudo[139462]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:41.987219 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph" returned: 0 in 1.065s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:41.988965 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 was vhdx, converting to raw {{(pid=129109) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Nov 13 21:07:41.990498 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp33hiq5f7 {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:42.012175 ncdv-master-1 sudo[139491]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp33hiq5f7 Nov 13 21:07:42.013785 ncdv-master-1 sudo[139491]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:43.634841 ncdv-master-1 sudo[139491]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:43.638351 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp33hiq5f7" returned: 0 in 1.648s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:43.639327 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:07:43.754310 ncdv-master-1 sudo[139506]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph Nov 13 21:07:43.755169 ncdv-master-1 sudo[139506]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 13 21:07:44.353312 ncdv-master-1 sudo[139506]: pam_unix(sudo:session): session closed for user root Nov 13 21:07:44.355563 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph" returned: 0 in 0.716s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:07:44.356582 ncdv-master-1 cinder-volume[129109]: WARNING py.warnings [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 13 21:07:44.356582 ncdv-master-1 cinder-volume[129109]: debtcollector.deprecate( Nov 13 21:07:44.356582 ncdv-master-1 cinder-volume[129109]: Nov 13 21:07:44.357882 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33752eb4-10ed-4e9e-a42e-f957ddc6e2a6_vwjorfjhncdv-master-1@ceph, size 700.00 MB, duration 1.65 sec, destination /opt/stack/data/cinder/conversion/tmp33hiq5f7 {{(pid=129109) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Nov 13 21:07:44.358446 ncdv-master-1 cinder-volume[129109]: INFO cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Converted 700.00 MB image at 424.56 MB/s Nov 13 21:07:44.359837 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:07:44.683937 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:07:44.694297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:07:44.892906 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] deleting rbd volume volume-18c32b32-209d-450d-8539-a9709a62ccee {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:07:49.312804 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp33hiq5f7 volume-18c32b32-209d-450d-8539-a9709a62ccee --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:08:18.034066 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:08:18.044493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:08:18.099908 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:08:18.128056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:08:56.351661 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp33hiq5f7 volume-18c32b32-209d-450d-8539-a9709a62ccee --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 67.039s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:08:56.477807 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:08:57.855126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:08:57.855760 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:08:57.855918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Downloaded image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 ((None, None)) to volume 18c32b32-209d-450d-8539-a9709a62ccee successfully. {{(pid=129109) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Nov 13 21:08:58.002836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Temporary image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 for user ef90efb6f8fd4bca86786e662f9d332e is deleted. {{(pid=129109) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Nov 13 21:08:58.147003 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:08:58.147824 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:08:58.432675 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created reservations ['c456d199-be5e-465e-87d0-ae91ed15ee2c', '78a70b29-deca-4579-86bc-79e70ddb7dbd', '16546e60-86f2-4012-b26c-0fa1f578887b', '8f223a95-aef8-4cfc-862e-801e9b64a752'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:08:58.446050 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Creating image volume entry: {'bootable': False, 'display_description': None, 'created_at': datetime.datetime(2021, 11, 13, 21, 7, 21, tzinfo=datetime.timezone.utc), 'shared_targets': True, 'provider_id': None, 'replication_extended_status': None, 'provider_location': None, 'consistencygroup_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'group_id': None, 'replication_status': None, 'metadata': {}, 'terminated_at': None, 'provider_auth': None, 'deleted_at': None, 'volume_type_id': '7b5d1537-c336-401c-97ba-43771254616f', 'deleted': False, 'size': 1, 'display_name': 'image-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'replication_driver_data': None, 'updated_at': datetime.datetime(2021, 11, 13, 21, 7, 21, tzinfo=datetime.timezone.utc), 'encryption_key_id': None, 'service_uuid': None, 'volume_admin_metadata': [], 'host': 'ncdv-master-1@ceph#ceph', 'project_id': '5c62bfce2e1c42ff851da53cfbfff43b', 'volume_metadata': [], 'scheduled_at': datetime.datetime(2021, 11, 13, 21, 7, 21, tzinfo=datetime.timezone.utc), 'multiattach': False, 'ec2_id': None, 'launched_at': None, 'availability_zone': 'nova', 'user_id': 'ef90efb6f8fd4bca86786e662f9d332e', 'cluster_name': None, 'provider_geometry': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '18c32b32-209d-450d-8539-a9709a62ccee'}. {{(pid=129109) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Nov 13 21:08:58.881218 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume reschedule parameters: False retry: None {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:08:58.897756 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:08:58.898292 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:08:58.971316 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (6a2026a0-4cfe-40b9-bb47-b43e86022c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:08:58.984782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65512135-0783-443e-adc4-eb93754a6a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:08:59.001557 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:08:59.048333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65512135-0783-443e-adc4-eb93754a6a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='image-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=59d2d75f-7538-4ca4-b73a-d76015a0a201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c62bfce2e1c42ff851da53cfbfff43b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=18c32b32-209d-450d-8539-a9709a62ccee,status='creating',terminated_at=None,updated_at=2021-11-13T21:07:21Z,use_quota=True,user_id='ef90efb6f8fd4bca86786e662f9d332e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:08:59.059398 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f3249c-1f33-4eef-8eac-b76aaed52c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:08:59.061698 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f3249c-1f33-4eef-8eac-b76aaed52c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:08:59.064087 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970a417-f26a-401c-b7ec-9f3fe3d62f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:08:59.092714 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6970a417-f26a-401c-b7ec-9f3fe3d62f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'volume_name': 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201', 'volume_size': 1, 'source_volid': '18c32b32-209d-450d-8539-a9709a62ccee', 'source_volstatus': 'downloading'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:08:59.099042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f58e4d-ac1c-45e2-8d64-c0dada2f4391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:08:59.110329 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f58e4d-ac1c-45e2-8d64-c0dada2f4391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:08:59.115575 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afa86c6-bbc4-46a6-9a49-de4db68d116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:08:59.116640 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume 59d2d75f-7538-4ca4-b73a-d76015a0a201: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201', 'volume_size': 1, 'source_volid': '18c32b32-209d-450d-8539-a9709a62ccee', 'source_volstatus': 'downloading'} Nov 13 21:08:59.138829 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:08:59.372049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] creating snapshot='volume-59d2d75f-7538-4ca4-b73a-d76015a0a201.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:09:01.518259 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] cloning 'volume-18c32b32-209d-450d-8539-a9709a62ccee@volume-59d2d75f-7538-4ca4-b73a-d76015a0a201.clone_snap' to 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:09:02.723886 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:02.727631 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:09:02.728009 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:09:03.425877 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:09:03.429677 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9afa86c6-bbc4-46a6-9a49-de4db68d116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201', 'volume_size': 1, 'source_volid': '18c32b32-209d-450d-8539-a9709a62ccee', 'source_volstatus': 'downloading'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:03.433136 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce81d086-0345-4cb0-ade3-053510c6ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:03.597588 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-59d2d75f-7538-4ca4-b73a-d76015a0a201 (59d2d75f-7538-4ca4-b73a-d76015a0a201): created successfully Nov 13 21:09:03.601833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce81d086-0345-4cb0-ade3-053510c6ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:03.610828 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (6a2026a0-4cfe-40b9-bb47-b43e86022c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:03.715526 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created volume successfully. Nov 13 21:09:04.128997 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Creating new image-volume cache entry for image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on ncdv-master-1@ceph#ceph {{(pid=129109) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Nov 13 21:09:04.231394 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] New image-volume cache entry created: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 9, 4, 132562)}. {{(pid=129109) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Nov 13 21:09:04.236986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 102.466s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:09:04.237617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Marking volume 18c32b32-209d-450d-8539-a9709a62ccee as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:09:04.324018 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 18c32b32-209d-450d-8539-a9709a62ccee. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:09:04.324786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Creating volume glance metadata for volume 18c32b32-209d-450d-8539-a9709a62ccee backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:09:04.581803 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 93.309s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:04.636576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8545a468-b243-4546-9fb3-cf9db777fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c32b32-209d-450d-8539-a9709a62ccee', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:04.638916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4e6a8d-8534-488d-9aca-956a74dbd509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:04.652341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 9, 4, 586452)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:09:04.654177 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:09:04.655241 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:09:04.663183 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.080s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:09:04.663961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:09:04.673516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 9, 4, 670981)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:09:04.674379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:09:04.675111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:09:04.691782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:04.923085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] creating snapshot='volume-eed44fc1-bbe1-4cab-a386-16dcc708610e.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:09:07.581835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-eed44fc1-bbe1-4cab-a386-16dcc708610e.clone_snap' to 'volume-eed44fc1-bbe1-4cab-a386-16dcc708610e' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:09:07.586320 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee (18c32b32-209d-450d-8539-a9709a62ccee): created successfully Nov 13 21:09:07.587804 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4e6a8d-8534-488d-9aca-956a74dbd509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:07.592811 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Flow 'volume_create_manager' (c93ad58a-1f44-41f3-bf34-58b48bccb0e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:07.666502 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-08068f35-ef08-40ca-83b8-8947bc1c96eb tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created volume successfully. Nov 13 21:09:08.834124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:08.837864 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:09:08.839475 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:09:09.305116 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:09:09.305897 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Marking volume eed44fc1-bbe1-4cab-a386-16dcc708610e as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:09:09.375716 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to eed44fc1-bbe1-4cab-a386-16dcc708610e. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:09:09.376292 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Creating volume glance metadata for volume eed44fc1-bbe1-4cab-a386-16dcc708610e backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:09:09.542309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (429a783b-00d2-4527-b4fa-0f9710420b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:09.551477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ebe8f1-92b9-49a3-bfc5-cf7329a6fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:09.708642 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Volume volume-eed44fc1-bbe1-4cab-a386-16dcc708610e (eed44fc1-bbe1-4cab-a386-16dcc708610e): created successfully Nov 13 21:09:09.710716 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0ebe8f1-92b9-49a3-bfc5-cf7329a6fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:09.714232 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Flow 'volume_create_manager' (3235527b-f7d3-45c2-812b-df7a58756a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:09.803094 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6777ee6d-0090-487b-af0a-2a968c007eca tempest-LiveMigrationTest-716427780 None] Created volume successfully. Nov 13 21:09:10.289824 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-9879f789-44ee-44f2-8c4d-d28ac74bae1a req-07973172-92c0-4a13-b1eb-8f9cc22e3313 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:09:11.209054 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-9879f789-44ee-44f2-8c4d-d28ac74bae1a req-07973172-92c0-4a13-b1eb-8f9cc22e3313 tempest-LiveAutoBlockMigrationV225Test-941742021 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.919s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:09:11.214541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-9879f789-44ee-44f2-8c4d-d28ac74bae1a req-07973172-92c0-4a13-b1eb-8f9cc22e3313 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18c32b32-209d-450d-8539-a9709a62ccee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '18c32b32-209d-450d-8539-a9709a62ccee', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:09:11.351471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-9879f789-44ee-44f2-8c4d-d28ac74bae1a req-07973172-92c0-4a13-b1eb-8f9cc22e3313 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Connection info returned from driver {'name': 'volumes/volume-18c32b32-209d-450d-8539-a9709a62ccee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18c32b32-209d-450d-8539-a9709a62ccee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9b21b00b-0554-4fca-a604-f652901ac1b6'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:09:11.511557 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-9879f789-44ee-44f2-8c4d-d28ac74bae1a req-07973172-92c0-4a13-b1eb-8f9cc22e3313 tempest-LiveAutoBlockMigrationV225Test-941742021 None] attachment_update completed successfully. Nov 13 21:09:15.299655 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-a12aa8d4-cf37-4bbe-bd96-24b7f8281b64 req-38802dc8-230a-47c6-80ef-f253b6d4c44f tempest-LiveMigrationTest-716427780 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:09:16.326482 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-a12aa8d4-cf37-4bbe-bd96-24b7f8281b64 req-38802dc8-230a-47c6-80ef-f253b6d4c44f tempest-LiveMigrationTest-716427780 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.027s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:09:16.327565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a12aa8d4-cf37-4bbe-bd96-24b7f8281b64 req-38802dc8-230a-47c6-80ef-f253b6d4c44f tempest-LiveMigrationTest-716427780 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'eed44fc1-bbe1-4cab-a386-16dcc708610e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:09:16.438163 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-a12aa8d4-cf37-4bbe-bd96-24b7f8281b64 req-38802dc8-230a-47c6-80ef-f253b6d4c44f tempest-LiveMigrationTest-716427780 None] Connection info returned from driver {'name': 'volumes/volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eed44fc1-bbe1-4cab-a386-16dcc708610e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5e745e16-dfa5-4d9c-97f5-62af7d810d9e'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:09:16.630114 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a12aa8d4-cf37-4bbe-bd96-24b7f8281b64 req-38802dc8-230a-47c6-80ef-f253b6d4c44f tempest-LiveMigrationTest-716427780 None] attachment_update completed successfully. Nov 13 21:09:18.034204 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:09:18.035391 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:18.100657 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:18.161491 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:09:33.644865 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:09:33.650399 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:09:33.651211 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:09:33.679139 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Flow 'volume_create_manager' (e8b1e1d1-2f00-46ca-8b73-2dbfa0749638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:33.684498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bb165-22ad-4c65-94e0-8d39ebae7267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:33.692876 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-abeaed58-e1c3-4201-bd8a-a55fcf25c8d4 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:09:33.722529 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:09:33.763488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bb165-22ad-4c65-94e0-8d39ebae7267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1489623865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ec78222-cbea-4f0f-983b-67c07faf543b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4e7a7342104f71af49e17cb449bbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:09:33Z,use_quota=True,user_id='82541b00a7e342b3a587116e4e677d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:33.782986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baae3465-8483-4098-959d-1ddfede1f819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:33.789787 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baae3465-8483-4098-959d-1ddfede1f819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:33.803835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c13dfd-8d6f-44d8-bf85-af5a232c09ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:33.806722 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c13dfd-8d6f-44d8-bf85-af5a232c09ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ec78222-cbea-4f0f-983b-67c07faf543b', 'volume_name': 'volume-6ec78222-cbea-4f0f-983b-67c07faf543b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:33.813877 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e33b46f-e097-432b-aede-5ecbc8fe402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:33.823066 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e33b46f-e097-432b-aede-5ecbc8fe402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:33.833814 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb6597a-dc87-40d6-a5d7-acc4f5d16916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:33.835599 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Volume 6ec78222-cbea-4f0f-983b-67c07faf543b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ec78222-cbea-4f0f-983b-67c07faf543b', 'volume_size': 1} Nov 13 21:09:33.838760 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] creating volume 'volume-6ec78222-cbea-4f0f-983b-67c07faf543b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:09:33.840895 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:34.526881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:09:34.527284 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:09:34.529680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb6597a-dc87-40d6-a5d7-acc4f5d16916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ec78222-cbea-4f0f-983b-67c07faf543b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:34.533059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c0488-ecce-436e-9286-9f964c44ec64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:34.548347 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-abeaed58-e1c3-4201-bd8a-a55fcf25c8d4 tempest-LiveAutoBlockMigrationV225Test-281244860 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.858s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:09:34.549239 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-abeaed58-e1c3-4201-bd8a-a55fcf25c8d4 tempest-LiveAutoBlockMigrationV225Test-281244860 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-18c32b32-209d-450d-8539-a9709a62ccee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '18c32b32-209d-450d-8539-a9709a62ccee', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:09:34.668984 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-abeaed58-e1c3-4201-bd8a-a55fcf25c8d4 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Connection info returned from driver {'name': 'volumes/volume-18c32b32-209d-450d-8539-a9709a62ccee', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '18c32b32-209d-450d-8539-a9709a62ccee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4a284266-6056-404b-a653-6685a675d5ce'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:09:34.673487 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Volume volume-6ec78222-cbea-4f0f-983b-67c07faf543b (6ec78222-cbea-4f0f-983b-67c07faf543b): created successfully Nov 13 21:09:34.675440 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990c0488-ecce-436e-9286-9f964c44ec64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:34.678603 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Flow 'volume_create_manager' (e8b1e1d1-2f00-46ca-8b73-2dbfa0749638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:34.826165 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-572943d5-ddd0-4bd2-b708-7d43a659519d tempest-VolumesAdminNegativeTest-1180999025 None] Created volume successfully. Nov 13 21:09:34.861287 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-abeaed58-e1c3-4201-bd8a-a55fcf25c8d4 tempest-LiveAutoBlockMigrationV225Test-281244860 None] attachment_update completed successfully. Nov 13 21:09:37.086918 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-26ef7788-f9b1-4971-b724-9efdd571505a req-a865975e-151b-4bc0-9252-f19e28bd14a1 tempest-VolumesAdminNegativeTest-1180999025 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:09:37.509289 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-39d56904-5a02-4101-8de4-165c6e627496 req-7cdca042-fd08-4329-84f1-616083ea354b tempest-LiveMigrationTest-637255377 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:09:37.991117 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-26ef7788-f9b1-4971-b724-9efdd571505a req-a865975e-151b-4bc0-9252-f19e28bd14a1 tempest-VolumesAdminNegativeTest-1180999025 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.904s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:09:37.992025 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-26ef7788-f9b1-4971-b724-9efdd571505a req-a865975e-151b-4bc0-9252-f19e28bd14a1 tempest-VolumesAdminNegativeTest-1180999025 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6ec78222-cbea-4f0f-983b-67c07faf543b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '6ec78222-cbea-4f0f-983b-67c07faf543b', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:09:38.100275 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-26ef7788-f9b1-4971-b724-9efdd571505a req-a865975e-151b-4bc0-9252-f19e28bd14a1 tempest-VolumesAdminNegativeTest-1180999025 None] Connection info returned from driver {'name': 'volumes/volume-6ec78222-cbea-4f0f-983b-67c07faf543b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6ec78222-cbea-4f0f-983b-67c07faf543b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a3075c38-a5c1-4448-ac76-25e338b4d0f3'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:09:38.244338 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-26ef7788-f9b1-4971-b724-9efdd571505a req-a865975e-151b-4bc0-9252-f19e28bd14a1 tempest-VolumesAdminNegativeTest-1180999025 None] attachment_update completed successfully. Nov 13 21:09:38.260719 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-39d56904-5a02-4101-8de4-165c6e627496 req-7cdca042-fd08-4329-84f1-616083ea354b tempest-LiveMigrationTest-637255377 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.752s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:09:38.261325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-39d56904-5a02-4101-8de4-165c6e627496 req-7cdca042-fd08-4329-84f1-616083ea354b tempest-LiveMigrationTest-637255377 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'eed44fc1-bbe1-4cab-a386-16dcc708610e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:09:38.369418 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-39d56904-5a02-4101-8de4-165c6e627496 req-7cdca042-fd08-4329-84f1-616083ea354b tempest-LiveMigrationTest-637255377 None] Connection info returned from driver {'name': 'volumes/volume-eed44fc1-bbe1-4cab-a386-16dcc708610e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eed44fc1-bbe1-4cab-a386-16dcc708610e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'db56ed7e-ba07-4f1c-b708-59b211b8f988'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:09:38.551975 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-39d56904-5a02-4101-8de4-165c6e627496 req-7cdca042-fd08-4329-84f1-616083ea354b tempest-LiveMigrationTest-637255377 None] attachment_update completed successfully. Nov 13 21:09:42.925652 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-f0c145cf-b875-4fb4-816a-81785b213692 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Terminate volume connection completed successfully. Nov 13 21:09:42.926275 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1aac6f7d-b22e-43d7-905e-5375b3dd6ec4 req-f0c145cf-b875-4fb4-816a-81785b213692 tempest-LiveAutoBlockMigrationV225Test-281244860 None] Deleting attachment 9b21b00b-0554-4fca-a604-f652901ac1b6. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:09:43.177506 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-4d5b99b8-cc85-4031-907a-6426b691be62 req-de0ce4dd-dd45-4813-b214-75267c9f2b2b tempest-VolumesAdminNegativeTest-1180999025 None] Terminate volume connection completed successfully. Nov 13 21:09:43.177919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4d5b99b8-cc85-4031-907a-6426b691be62 req-de0ce4dd-dd45-4813-b214-75267c9f2b2b tempest-VolumesAdminNegativeTest-1180999025 None] Deleting attachment a3075c38-a5c1-4448-ac76-25e338b4d0f3. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:09:45.700939 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:09:45.705115 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:09:45.705860 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:09:45.721115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Flow 'volume_create_manager' (d4f1cc81-db8e-4f74-98d7-de759186a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:45.724681 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0b5c5-2b7c-4f04-96a8-1c7356228c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:45.731429 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:09:45.744309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c0b5c5-2b7c-4f04-96a8-1c7356228c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1901552242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d289f162-19e4-4e9e-9531-30f3f0779ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4e7a7342104f71af49e17cb449bbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:09:45Z,use_quota=True,user_id='82541b00a7e342b3a587116e4e677d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:45.746842 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a7b97a-1d61-4578-915b-fc580ff20651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:45.748916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a7b97a-1d61-4578-915b-fc580ff20651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:45.751199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5796194-575e-473e-a507-536dbc3ba784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:45.753418 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5796194-575e-473e-a507-536dbc3ba784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd289f162-19e4-4e9e-9531-30f3f0779ea3', 'volume_name': 'volume-d289f162-19e4-4e9e-9531-30f3f0779ea3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:45.755633 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801ff3a9-03a0-4f4f-8d06-0f764503dc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:45.758253 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801ff3a9-03a0-4f4f-8d06-0f764503dc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:45.760615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff740311-2904-4876-999f-5b747da0f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:45.761596 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Volume d289f162-19e4-4e9e-9531-30f3f0779ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d289f162-19e4-4e9e-9531-30f3f0779ea3', 'volume_size': 1} Nov 13 21:09:45.762174 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] creating volume 'volume-d289f162-19e4-4e9e-9531-30f3f0779ea3' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:09:45.763435 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:47.025388 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:09:47.026109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:09:47.027828 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff740311-2904-4876-999f-5b747da0f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d289f162-19e4-4e9e-9531-30f3f0779ea3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:47.036709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fb711d-7cf0-4fbe-ba73-c7d8c55e50f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:47.151021 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Volume volume-d289f162-19e4-4e9e-9531-30f3f0779ea3 (d289f162-19e4-4e9e-9531-30f3f0779ea3): created successfully Nov 13 21:09:47.156007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7fb711d-7cf0-4fbe-ba73-c7d8c55e50f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:47.160804 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Flow 'volume_create_manager' (d4f1cc81-db8e-4f74-98d7-de759186a569) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:47.237331 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a6379d08-50a8-4ecf-9754-7582d990b79c tempest-VolumesAdminNegativeTest-1180999025 None] Created volume successfully. Nov 13 21:09:47.688935 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-39d56904-5a02-4101-8de4-165c6e627496 req-482ea08b-585e-4549-a4b9-923b595a1dd4 tempest-LiveMigrationTest-637255377 None] Terminate volume connection completed successfully. Nov 13 21:09:47.689555 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-39d56904-5a02-4101-8de4-165c6e627496 req-482ea08b-585e-4549-a4b9-923b595a1dd4 tempest-LiveMigrationTest-637255377 None] Deleting attachment 5e745e16-dfa5-4d9c-97f5-62af7d810d9e. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:09:48.014056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Lock "b'cinder-d289f162-19e4-4e9e-9531-30f3f0779ea3-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:48.151810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:48.353907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:48.354736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Volume volume-d289f162-19e4-4e9e-9531-30f3f0779ea3 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:48.497199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] deleting rbd volume volume-d289f162-19e4-4e9e-9531-30f3f0779ea3 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:09:50.394780 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-a036ed94-8f82-4867-87bf-8d919173a625 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Terminate volume connection completed successfully. Nov 13 21:09:50.396035 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-a036ed94-8f82-4867-87bf-8d919173a625 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deleting attachment 4a284266-6056-404b-a653-6685a675d5ce. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:09:51.160199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-18c32b32-209d-450d-8539-a9709a62ccee-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:51.317910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:51.880120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:51.880673 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] volume has clone snapshot(s) {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1207}} Nov 13 21:09:51.882166 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:53.054978 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-1508602e-52cb-4821-8d5b-54dad4ad2b04-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:53.236290 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:53.565547 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:53.566283 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Volume volume-1508602e-52cb-4821-8d5b-54dad4ad2b04 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:53.922990 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] deleting rbd volume volume-1508602e-52cb-4821-8d5b-54dad4ad2b04 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:09:55.785818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created reservations ['2ff503c8-5ad6-435e-9ac0-e3ee88838286', '16e5cae1-628a-44e6-b98a-347b3c0cfdaa', '6acaa135-56a7-4f05-828b-c3404cf84206', 'c1e43f98-002f-4b41-abc5-c166a0550112'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:09:55.981257 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Created reservations ['f2bfc4cb-8de1-4a50-8314-e0ea24b418d8', '5896e4e5-a7dd-4a4b-8a54-ffa990c96f02', '84fe93b2-b14e-425a-982b-040a8ebad1f9', '167eeb1c-55cb-44e8-97fd-2831cb377628'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:09:56.239626 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:56.357977 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:56.468301 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:09:56.502007 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deleted volume successfully. Nov 13 21:09:56.551026 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-c191540b-3563-406d-b797-ce52ddaa38bc req-5d1d3cb0-504d-4634-88b0-7b7d8c0930d5 tempest-LiveMigrationTest-716427780 None] Terminate volume connection completed successfully. Nov 13 21:09:56.560010 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-c191540b-3563-406d-b797-ce52ddaa38bc req-5d1d3cb0-504d-4634-88b0-7b7d8c0930d5 tempest-LiveMigrationTest-716427780 None] Deleting attachment db56ed7e-ba07-4f1c-b708-59b211b8f988. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:09:56.832063 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:09:56.840118 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:09:56.840585 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:09:56.868228 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Flow 'volume_create_manager' (3736fd9d-ad9e-4472-91c4-e4798d71d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:56.878717 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac927b3c-74c1-426f-b8b4-889f446b71b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:56.885564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:56.993526 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:57.049250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:09:57.061401 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:09:57.094914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac927b3c-74c1-426f-b8b4-889f446b71b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-854530333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2f077cb2-609f-4827-9110-7b8acba03090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='938071fbfe8f48a7b5abb40d48854ae9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:09:57Z,use_quota=True,user_id='1cf3263d6f794339ae99ddc3b3fe6a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:57.095356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9073c3a2-4ba4-4366-a7d0-7cce152cb6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:57.095804 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9073c3a2-4ba4-4366-a7d0-7cce152cb6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:57.098178 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1678dff-1802-449a-935f-68c72075e937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:57.100333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1678dff-1802-449a-935f-68c72075e937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f077cb2-609f-4827-9110-7b8acba03090', 'volume_name': 'volume-2f077cb2-609f-4827-9110-7b8acba03090', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:57.113742 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600ff06b-f984-4254-b194-2171714ae3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:57.117837 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600ff06b-f984-4254-b194-2171714ae3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:57.118902 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0298be0-cae2-49f8-9d41-1c694b49edba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:57.119353 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Volume 2f077cb2-609f-4827-9110-7b8acba03090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f077cb2-609f-4827-9110-7b8acba03090', 'volume_size': 1} Nov 13 21:09:57.124836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] creating volume 'volume-2f077cb2-609f-4827-9110-7b8acba03090' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:09:57.125688 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:57.197999 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-a1bc9bf0-266b-48c7-ac28-2fa8800710e0 req-1f40f2cf-b136-40ba-a4ef-c09b6e25feaa tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-18c32b32-209d-450d-8539-a9709a62ccee-delete_volume'" released by "delete_volume" :: held 6.038s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:09:57.206348 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Deleted volume successfully. Nov 13 21:09:57.231639 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Lock "b'cinder-6ec78222-cbea-4f0f-983b-67c07faf543b-delete_volume'" acquired by "delete_volume" :: waited 0.152s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:57.247676 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-eed44fc1-bbe1-4cab-a386-16dcc708610e-delete_volume'" acquired by "delete_volume" :: waited 0.045s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:57.303507 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-43650628-973c-4157-ae02-e84d82d8f8f2 tempest-VolumesAdminNegativeTest-1180999025 None] Lock "b'cinder-d289f162-19e4-4e9e-9531-30f3f0779ea3-delete_volume'" released by "delete_volume" :: held 9.289s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:09:57.386044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:57.785589 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:57.786359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Volume volume-6ec78222-cbea-4f0f-983b-67c07faf543b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:58.099704 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] deleting rbd volume volume-6ec78222-cbea-4f0f-983b-67c07faf543b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:09:58.136148 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:58.638892 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:58.963425 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] deleting rbd volume volume-eed44fc1-bbe1-4cab-a386-16dcc708610e {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:09:58.988958 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:09:58.989585 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:09:58.992284 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0298be0-cae2-49f8-9d41-1c694b49edba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f077cb2-609f-4827-9110-7b8acba03090', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:58.995481 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed6b1db-4232-434c-9b45-a8f19345f46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:09:59.012732 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-a28c0d37-ba75-45b4-92a6-c531bf435b2b-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:09:59.061880 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Volume volume-2f077cb2-609f-4827-9110-7b8acba03090 (2f077cb2-609f-4827-9110-7b8acba03090): created successfully Nov 13 21:09:59.064109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed6b1db-4232-434c-9b45-a8f19345f46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:09:59.067297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Flow 'volume_create_manager' (3736fd9d-ad9e-4472-91c4-e4798d71d98c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:09:59.118248 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:09:59.534341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:09:59.535308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Volume volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:09:59.839410 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] deleting rbd volume volume-a28c0d37-ba75-45b4-92a6-c531bf435b2b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:09:59.841337 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-552ea9c2-1bf4-4733-8804-a2ee90a77ac5 tempest-DeleteServersTestJSON-1013033532 None] Created volume successfully. Nov 13 21:10:01.037490 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-8997f941-770c-43d6-b5d4-24e66efb2313 req-fa9bfc0c-920b-4ffb-8d19-31f9b7fdf97f tempest-DeleteServersTestJSON-1013033532 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:10:01.901923 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-8997f941-770c-43d6-b5d4-24e66efb2313 req-fa9bfc0c-920b-4ffb-8d19-31f9b7fdf97f tempest-DeleteServersTestJSON-1013033532 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.863s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:10:01.903671 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-8997f941-770c-43d6-b5d4-24e66efb2313 req-fa9bfc0c-920b-4ffb-8d19-31f9b7fdf97f tempest-DeleteServersTestJSON-1013033532 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2f077cb2-609f-4827-9110-7b8acba03090', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '2f077cb2-609f-4827-9110-7b8acba03090', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:10:02.045736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-8997f941-770c-43d6-b5d4-24e66efb2313 req-fa9bfc0c-920b-4ffb-8d19-31f9b7fdf97f tempest-DeleteServersTestJSON-1013033532 None] Connection info returned from driver {'name': 'volumes/volume-2f077cb2-609f-4827-9110-7b8acba03090', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2f077cb2-609f-4827-9110-7b8acba03090', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0eb71924-7e0b-4138-9646-11ac85c12170'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:10:02.184333 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-8997f941-770c-43d6-b5d4-24e66efb2313 req-fa9bfc0c-920b-4ffb-8d19-31f9b7fdf97f tempest-DeleteServersTestJSON-1013033532 None] attachment_update completed successfully. Nov 13 21:10:02.439126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Created reservations ['1801a751-7330-496f-a2bd-c3992f4663a8', '4f5ca82b-078e-47da-b8d0-43c0b97c94e6', 'c0f5e2c7-1d9f-4624-b6e0-1e31d2da04c5', '2673528a-4e99-4c94-b7cb-5ef815a38eb7'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:10:02.688296 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:02.850332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:03.001843 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:10:03.011853 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Deleted volume successfully. Nov 13 21:10:03.133361 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-cc69e3f1-42c4-482c-b4aa-bf822f57fbc4 tempest-LiveAutoBlockMigrationV225Test-941742021 None] Lock "b'cinder-1508602e-52cb-4821-8d5b-54dad4ad2b04-delete_volume'" released by "delete_volume" :: held 10.077s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:10:07.473995 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Created reservations ['f09a4b2a-a7fd-4748-9c17-f8b6f03f7d6c', 'e4f21a6e-0523-4727-80d1-ff592310bbba', '0aa542ab-1f21-469f-9139-caa055cd70c1', 'b27bbbfd-5315-41c5-9ff1-ee4989e27be2'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:10:07.806020 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:07.840619 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:07.901459 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:10:07.911741 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Deleted volume successfully. Nov 13 21:10:07.992890 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-85316b2a-6eed-4ea9-acca-942e837f63f8 tempest-VolumesAdminNegativeTest-1180999025 None] Lock "b'cinder-6ec78222-cbea-4f0f-983b-67c07faf543b-delete_volume'" released by "delete_volume" :: held 10.760s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:10:08.407927 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Created reservations ['254db814-07cd-4e6e-9438-8877128efac5', '7fb2be69-5800-464a-a3c8-b2e80af9ed23', 'e4cf9f3f-56a8-4f25-8c59-e0ee250e041c', '6c2ce804-7c4f-47b5-88e8-99b3b605f954'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:10:08.651894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:10:09.145935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] deleting parent snapshot volume-eed44fc1-bbe1-4cab-a386-16dcc708610e.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:10:11.725042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:11.849109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:11.887346 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:10:11.918872 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Deleted volume successfully. Nov 13 21:10:11.962945 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-e17525fc-6de6-41ea-9b2d-c48a68fe0b61 req-5c48c98f-c7b9-4910-aed8-057672607e99 tempest-DeleteServersTestJSON-1013033532 None] Terminate volume connection completed successfully. Nov 13 21:10:11.966008 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-e17525fc-6de6-41ea-9b2d-c48a68fe0b61 req-5c48c98f-c7b9-4910-aed8-057672607e99 tempest-DeleteServersTestJSON-1013033532 None] Deleting attachment 0eb71924-7e0b-4138-9646-11ac85c12170. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:10:12.079547 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ccf2aeec-9de3-478d-a9aa-e9c7c9932414 tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-a28c0d37-ba75-45b4-92a6-c531bf435b2b-delete_volume'" released by "delete_volume" :: held 13.062s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:10:12.204665 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] Created reservations ['59e63574-b8a9-427c-8380-a5452fe355d6', '348a0b0f-6c77-4163-9732-986b292f222d', '6fe7ec30-fa7b-49f6-9b6c-e7727ae07e6a', 'cb7c169e-507c-4747-b1cb-2c92f955aa8c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:10:12.433850 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:12.476054 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:12.531362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:10:12.535897 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] Deleted volume successfully. Nov 13 21:10:12.623941 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-c191540b-3563-406d-b797-ce52ddaa38bc req-0632c407-7b32-4c17-a5bb-e41a26e37af2 tempest-LiveMigrationTest-716427780 None] Lock "b'cinder-eed44fc1-bbe1-4cab-a386-16dcc708610e-delete_volume'" released by "delete_volume" :: held 15.376s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:10:18.037272 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:10:18.038652 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:18.194913 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:10:18.306446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:11:18.042628 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:11:18.045381 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:11:18.177262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:11:18.302415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:12:18.047602 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:12:18.048489 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:18.100935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:18.169910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:12:30.573339 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:12:30.577043 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:12:30.577960 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:12:30.640286 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Flow 'volume_create_manager' (a653e0e6-5eb6-47c2-92ba-34d512f2b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:12:30.655413 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0d1555-e8ce-410b-8d7d-31091dfc05b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:30.697605 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:12:30.744465 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0d1555-e8ce-410b-8d7d-31091dfc05b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1371253718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b93f8655-f33f-4318-9e1b-8e9813108cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ea50d2d303c4872b717101b06ff111f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:12:30Z,use_quota=True,user_id='280d32479797435186f634594e607dc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:30.759727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18cfed2-0b6c-40e5-bcef-124332f25c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:30.767348 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a18cfed2-0b6c-40e5-bcef-124332f25c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:30.775489 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833589d0-c3cf-43dd-91d6-35d348f820d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:30.782177 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833589d0-c3cf-43dd-91d6-35d348f820d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93f8655-f33f-4318-9e1b-8e9813108cb6', 'volume_name': 'volume-b93f8655-f33f-4318-9e1b-8e9813108cb6', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:30.787157 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57091e49-7a7c-4499-a95a-c7a464b0c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:30.793432 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57091e49-7a7c-4499-a95a-c7a464b0c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:30.800593 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8da148-0c68-4cff-b26a-d1b66fedc95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:30.806988 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Volume b93f8655-f33f-4318-9e1b-8e9813108cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93f8655-f33f-4318-9e1b-8e9813108cb6', 'volume_size': 1} Nov 13 21:12:30.807651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] creating volume 'volume-b93f8655-f33f-4318-9e1b-8e9813108cb6' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:12:30.811797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:31.634064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:12:31.635096 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:12:31.637667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8da148-0c68-4cff-b26a-d1b66fedc95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93f8655-f33f-4318-9e1b-8e9813108cb6', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:31.640240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7bc373-6d34-4b97-8b35-b68865fda8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:12:31.729987 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Volume volume-b93f8655-f33f-4318-9e1b-8e9813108cb6 (b93f8655-f33f-4318-9e1b-8e9813108cb6): created successfully Nov 13 21:12:31.732277 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce7bc373-6d34-4b97-8b35-b68865fda8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:12:31.736727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Flow 'volume_create_manager' (a653e0e6-5eb6-47c2-92ba-34d512f2b182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:12:31.841087 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9de7bb12-66de-436d-abeb-761ff624b4e0 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Created volume successfully. Nov 13 21:12:34.254859 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-3360e32a-51f3-4938-a767-151448e331fd req-301beed3-b511-4e1f-95ce-530ef5ba6516 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:12:35.954382 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-3360e32a-51f3-4938-a767-151448e331fd req-301beed3-b511-4e1f-95ce-530ef5ba6516 tempest-AttachSCSIVolumeTestJSON-1243029663 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.699s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:12:35.955172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3360e32a-51f3-4938-a767-151448e331fd req-301beed3-b511-4e1f-95ce-530ef5ba6516 tempest-AttachSCSIVolumeTestJSON-1243029663 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b93f8655-f33f-4318-9e1b-8e9813108cb6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'b93f8655-f33f-4318-9e1b-8e9813108cb6', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:12:36.075279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-3360e32a-51f3-4938-a767-151448e331fd req-301beed3-b511-4e1f-95ce-530ef5ba6516 tempest-AttachSCSIVolumeTestJSON-1243029663 None] Connection info returned from driver {'name': 'volumes/volume-b93f8655-f33f-4318-9e1b-8e9813108cb6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b93f8655-f33f-4318-9e1b-8e9813108cb6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5f62fe33-e0ff-42c4-b3c1-3df3ca4ededd'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:12:36.271126 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-3360e32a-51f3-4938-a767-151448e331fd req-301beed3-b511-4e1f-95ce-530ef5ba6516 tempest-AttachSCSIVolumeTestJSON-1243029663 None] attachment_update completed successfully. Nov 13 21:12:40.969301 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a5f2fd19-d782-46a5-a2d0-138f1f8fb8e1 req-a2401818-1e77-457e-bd07-041f258fb88f tempest-AttachSCSIVolumeTestJSON-1243029663 None] Terminate volume connection completed successfully. Nov 13 21:12:40.969301 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-a5f2fd19-d782-46a5-a2d0-138f1f8fb8e1 req-a2401818-1e77-457e-bd07-041f258fb88f tempest-AttachSCSIVolumeTestJSON-1243029663 None] Deleting attachment 5f62fe33-e0ff-42c4-b3c1-3df3ca4ededd. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:12:50.405916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Lock "b'cinder-b93f8655-f33f-4318-9e1b-8e9813108cb6-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:12:50.548168 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:50.740680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:12:50.741288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Volume volume-b93f8655-f33f-4318-9e1b-8e9813108cb6 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:12:50.903745 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] deleting rbd volume volume-b93f8655-f33f-4318-9e1b-8e9813108cb6 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:12:56.072678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Created reservations ['aa84087e-ef4c-4864-bda3-d410f6aa92b7', '9e62110e-c6b1-4edc-9087-e4abaed29ea8', '8217680e-604f-48a9-8461-9a87114d1f16', 'af5f270a-4ec8-452f-9e51-6c1cac87d272'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:12:56.280722 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:56.329108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:12:56.370523 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:12:56.377514 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Deleted volume successfully. Nov 13 21:12:56.450620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e3264082-8e61-40ba-9459-30e198a26a7e tempest-AttachSCSIVolumeTestJSON-1243029663 None] Lock "b'cinder-b93f8655-f33f-4318-9e1b-8e9813108cb6-delete_volume'" released by "delete_volume" :: held 6.045s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:13:18.050715 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:13:18.051407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:13:18.115222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:13:18.238111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:13:41.028194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Lock "b'cinder-2f077cb2-609f-4827-9110-7b8acba03090-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:13:41.174304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:13:41.395534 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:13:41.395534 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Volume volume-2f077cb2-609f-4827-9110-7b8acba03090 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:13:41.525189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] deleting rbd volume volume-2f077cb2-609f-4827-9110-7b8acba03090 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:13:45.256901 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Created reservations ['13953943-957f-468e-b65b-960e40a4430d', '3d6b3874-6d16-4809-b0f9-79a97a0d4821', 'b54f7573-1835-499c-9364-2bd14fbca63c', '2dedb220-511f-4dc7-8019-28bd9cbebe78'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:13:45.479654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:13:45.539091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:13:45.598264 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:13:45.602746 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Deleted volume successfully. Nov 13 21:13:45.694479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4537421d-922d-4bdd-8086-a98b8e51e600 tempest-DeleteServersTestJSON-1013033532 None] Lock "b'cinder-2f077cb2-609f-4827-9110-7b8acba03090-delete_volume'" released by "delete_volume" :: held 4.666s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:14:18.045574 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:14:18.048705 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:14:18.091818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:14:18.198977 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:15:05.968181 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:15:05.974724 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:15:05.975680 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:15:05.996390 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (9cb29a1d-5899-4a8a-9f7d-aa497b8104e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:06.000573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500cbc7-90d5-45ea-9d41-84af008ca6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:06.020991 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:15:06.040781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500cbc7-90d5-45ea-9d41-84af008ca6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-2129549825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cde6a79d-d391-4d0a-b774-fcaf549a49e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84baa7abcdc940809d5ca82bb822a17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:15:06Z,use_quota=True,user_id='d0240c53ee914b8fa8b928f1ef8d3a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:06.044552 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b09219d-dd82-4c6e-8704-5c88fef30740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:06.047193 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b09219d-dd82-4c6e-8704-5c88fef30740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:06.050987 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d268817-b29e-48fc-abaf-58f474347cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:06.148552 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d268817-b29e-48fc-abaf-58f474347cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'volume_name': 'volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:06.151915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7b47c7-7e10-4eff-a8a4-3045a97ac2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:06.154320 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7b47c7-7e10-4eff-a8a4-3045a97ac2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:06.162885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de2f6b-9877-4c3e-a632-0389646f7c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:06.167511 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume cde6a79d-d391-4d0a-b774-fcaf549a49e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:15:06.172822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Cloning cde6a79d-d391-4d0a-b774-fcaf549a49e6 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:15:06.187542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:15:06.247332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 15, 6, 191851)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:15:06.247944 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:15:06.248493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:15:06.256928 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.069s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:15:06.258174 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:15:06.264927 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 15, 6, 262482)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:15:06.265661 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:15:06.267810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:15:06.282725 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:06.574518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] creating snapshot='volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:15:07.962849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6.clone_snap' to 'volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:15:09.317421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:15:09.318458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:15:09.318833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:15:09.676772 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:15:09.677592 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Marking volume cde6a79d-d391-4d0a-b774-fcaf549a49e6 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:15:09.754420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to cde6a79d-d391-4d0a-b774-fcaf549a49e6. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:15:09.754745 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Creating volume glance metadata for volume cde6a79d-d391-4d0a-b774-fcaf549a49e6 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:15:09.919835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8de2f6b-9877-4c3e-a632-0389646f7c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:09.922376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe5690f-883e-4330-b159-2c84d1047988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:10.044278 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6 (cde6a79d-d391-4d0a-b774-fcaf549a49e6): created successfully Nov 13 21:15:10.047050 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe5690f-883e-4330-b159-2c84d1047988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:10.051026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (9cb29a1d-5899-4a8a-9f7d-aa497b8104e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:10.119277 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1f4ece5d-07de-49ad-b6a2-50f9b0d485d3 tempest-TaggedBootDevicesTest_v242-209704149 None] Created volume successfully. Nov 13 21:15:12.204536 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:15:12.208889 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:15:12.209462 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:15:12.232599 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (899e0d7b-873f-4fc5-8021-464a00c232b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:12.243099 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad780ee-40c7-494a-9fca-58a9efab588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:12.256965 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:15:12.283125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ad780ee-40c7-494a-9fca-58a9efab588a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-687415028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90b790f4-4687-48d2-96c5-c007915fee58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84baa7abcdc940809d5ca82bb822a17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:15:12Z,use_quota=True,user_id='d0240c53ee914b8fa8b928f1ef8d3a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:12.287300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c8b55-0283-4abf-9846-9a63aa7a1e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:12.289903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c8b55-0283-4abf-9846-9a63aa7a1e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:12.293353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53a5c6-66a4-4200-880b-ec30c6460927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:12.296235 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f53a5c6-66a4-4200-880b-ec30c6460927) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b790f4-4687-48d2-96c5-c007915fee58', 'volume_name': 'volume-90b790f4-4687-48d2-96c5-c007915fee58', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:12.299954 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a530a-7d23-46bc-8cf9-1743e49efa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:12.302597 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e8a530a-7d23-46bc-8cf9-1743e49efa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:12.305929 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57357b17-d61f-4f6a-8e57-2d9d24a3f45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:12.306741 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume 90b790f4-4687-48d2-96c5-c007915fee58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b790f4-4687-48d2-96c5-c007915fee58', 'volume_size': 1} Nov 13 21:15:12.308462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] creating volume 'volume-90b790f4-4687-48d2-96c5-c007915fee58' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:15:12.309828 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:13.485432 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:15:13.486113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:15:13.487777 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57357b17-d61f-4f6a-8e57-2d9d24a3f45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b790f4-4687-48d2-96c5-c007915fee58', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:13.489974 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb43396-c60a-473a-8470-6a006bdaac1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:13.574590 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-90b790f4-4687-48d2-96c5-c007915fee58 (90b790f4-4687-48d2-96c5-c007915fee58): created successfully Nov 13 21:15:13.587207 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fb43396-c60a-473a-8470-6a006bdaac1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:13.587207 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (899e0d7b-873f-4fc5-8021-464a00c232b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:13.692235 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8c284d30-2663-456a-9299-078bb65d9f83 tempest-TaggedBootDevicesTest_v242-209704149 None] Created volume successfully. Nov 13 21:15:15.305712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:15:15.317027 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:15:15.318160 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:15:15.352331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (c7b840de-7a78-4cb2-afa3-3d33681c1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:15.366271 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b67637a-d658-45e7-b99e-e1310776f16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:15.380332 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:15:15.405399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b67637a-d658-45e7-b99e-e1310776f16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1269230959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae00dcaf-50d7-4b31-8fe3-5de55a83bba9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84baa7abcdc940809d5ca82bb822a17c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:15:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:15:15Z,use_quota=True,user_id='d0240c53ee914b8fa8b928f1ef8d3a3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:15.419458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd77d26-6e90-42d2-9ac1-bda21500d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:15.423223 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd77d26-6e90-42d2-9ac1-bda21500d23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:15.426376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4f713a-a6c0-4fed-895c-83b86e259fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:15.428660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4f713a-a6c0-4fed-895c-83b86e259fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'volume_name': 'volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:15.431660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375424a1-d2db-4adb-986a-61b2899f1600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:15.434969 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375424a1-d2db-4adb-986a-61b2899f1600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:15.438819 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe80879-cccc-4ef5-bf6e-96fd07673f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:15.451704 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume ae00dcaf-50d7-4b31-8fe3-5de55a83bba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'volume_size': 1} Nov 13 21:15:15.454528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] creating volume 'volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:15:15.455799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:16.047146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:15:16.048006 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:15:16.050406 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe80879-cccc-4ef5-bf6e-96fd07673f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:16.053213 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f09c423-f542-4fa0-a949-0a4f26f86040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:16.110482 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9 (ae00dcaf-50d7-4b31-8fe3-5de55a83bba9): created successfully Nov 13 21:15:16.112832 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f09c423-f542-4fa0-a949-0a4f26f86040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:16.116988 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Flow 'volume_create_manager' (c7b840de-7a78-4cb2-afa3-3d33681c1679) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:16.173578 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-90622e32-42ab-4e11-b987-0ee25044acf9 tempest-TaggedBootDevicesTest_v242-209704149 None] Created volume successfully. Nov 13 21:15:18.045103 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:15:18.046641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:18.130291 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:18.208125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:15:26.971049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:15:26.976404 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:15:26.977095 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:15:27.013991 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Flow 'volume_create_manager' (36345644-379d-42d4-879e-7e05bf1d5bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:27.018504 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24496b29-7c34-439f-b69a-295663e6559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:27.029543 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:15:27.043821 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24496b29-7c34-439f-b69a-295663e6559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-261635054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9d87ed4d-ccbe-414d-839c-e50e18c1e8dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29c0ac61023840cb8ede1c4db0e052f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:15:27Z,use_quota=True,user_id='46d72f0c886043c9bf098f3f372c31de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:27.046857 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1cdbd7-e7b3-4e62-8495-8a1f711a24a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:27.049398 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1cdbd7-e7b3-4e62-8495-8a1f711a24a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:27.052519 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8025bd-51bc-4692-8bd1-a44cd160fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:27.207441 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc8025bd-51bc-4692-8bd1-a44cd160fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'volume_name': 'volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:27.220506 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92f93e3-7149-4118-9523-67037a51713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:27.223328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92f93e3-7149-4118-9523-67037a51713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:27.227858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a5129d-50e0-4047-bbfc-0fc1d9b45dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:27.230139 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Volume 9d87ed4d-ccbe-414d-839c-e50e18c1e8dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:15:27.230907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Cloning 9d87ed4d-ccbe-414d-839c-e50e18c1e8dc from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:15:27.246207 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:15:27.310088 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 15, 27, 250845)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:15:27.311739 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:15:27.312451 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:15:27.321298 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.074s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:15:27.321298 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:15:27.338442 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 15, 27, 328024)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:15:27.339296 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:15:27.340086 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:15:27.354555 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:15:27.594603 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] creating snapshot='volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:15:29.574153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc.clone_snap' to 'volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:15:30.896854 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:15:30.898727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:15:30.899330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:15:31.299132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:15:31.300297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Marking volume 9d87ed4d-ccbe-414d-839c-e50e18c1e8dc as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:15:31.374612 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 9d87ed4d-ccbe-414d-839c-e50e18c1e8dc. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:15:31.375032 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Creating volume glance metadata for volume 9d87ed4d-ccbe-414d-839c-e50e18c1e8dc backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:15:31.573016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36a5129d-50e0-4047-bbfc-0fc1d9b45dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:31.573132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9667bb5-a530-4dbc-98f7-912e7c4a23be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:15:31.647575 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Volume volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc (9d87ed4d-ccbe-414d-839c-e50e18c1e8dc): created successfully Nov 13 21:15:31.651554 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9667bb5-a530-4dbc-98f7-912e7c4a23be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:15:31.658854 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Flow 'volume_create_manager' (36345644-379d-42d4-879e-7e05bf1d5bc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:15:31.727538 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-79558cb7-22e5-4be1-baf3-2c06f8be68f6 tempest-ServersTestBootFromVolume-876085019 None] Created volume successfully. Nov 13 21:15:37.926551 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-7aabaf89-f4dd-4e04-8e41-52bff9014e59 req-260252ef-9aad-470e-8b2c-15f0326d3b5a tempest-ServersTestBootFromVolume-876085019 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:15:39.061619 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-7aabaf89-f4dd-4e04-8e41-52bff9014e59 req-260252ef-9aad-470e-8b2c-15f0326d3b5a tempest-ServersTestBootFromVolume-876085019 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.135s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:15:39.063443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-7aabaf89-f4dd-4e04-8e41-52bff9014e59 req-260252ef-9aad-470e-8b2c-15f0326d3b5a tempest-ServersTestBootFromVolume-876085019 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:15:39.231964 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-7aabaf89-f4dd-4e04-8e41-52bff9014e59 req-260252ef-9aad-470e-8b2c-15f0326d3b5a tempest-ServersTestBootFromVolume-876085019 None] Connection info returned from driver {'name': 'volumes/volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9d87ed4d-ccbe-414d-839c-e50e18c1e8dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f6af944d-0383-4f67-b8b8-76f3e015cb3d'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:15:39.437453 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-7aabaf89-f4dd-4e04-8e41-52bff9014e59 req-260252ef-9aad-470e-8b2c-15f0326d3b5a tempest-ServersTestBootFromVolume-876085019 None] attachment_update completed successfully. Nov 13 21:15:54.148186 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-458af772-7727-44e9-900b-8df69f574e20 tempest-TaggedBootDevicesTest_v242-209704149 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:15:55.111837 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-458af772-7727-44e9-900b-8df69f574e20 tempest-TaggedBootDevicesTest_v242-209704149 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.963s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:15:55.113769 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-db79a199-0706-40eb-9e06-eb964144568e req-458af772-7727-44e9-900b-8df69f574e20 tempest-TaggedBootDevicesTest_v242-209704149 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:15:55.235640 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-458af772-7727-44e9-900b-8df69f574e20 tempest-TaggedBootDevicesTest_v242-209704149 None] Connection info returned from driver {'name': 'volumes/volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'cde6a79d-d391-4d0a-b774-fcaf549a49e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8af20cd5-35de-4e77-b0ff-2339998d4609'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:15:55.351347 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-458af772-7727-44e9-900b-8df69f574e20 tempest-TaggedBootDevicesTest_v242-209704149 None] attachment_update completed successfully. Nov 13 21:15:56.207549 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-ffb48131-93a3-4089-be90-9be05dbdfcc8 tempest-TaggedBootDevicesTest_v242-209704149 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:15:57.094880 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-ffb48131-93a3-4089-be90-9be05dbdfcc8 tempest-TaggedBootDevicesTest_v242-209704149 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.888s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:15:57.095878 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-db79a199-0706-40eb-9e06-eb964144568e req-ffb48131-93a3-4089-be90-9be05dbdfcc8 tempest-TaggedBootDevicesTest_v242-209704149 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90b790f4-4687-48d2-96c5-c007915fee58', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '90b790f4-4687-48d2-96c5-c007915fee58', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:15:57.190294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-ffb48131-93a3-4089-be90-9be05dbdfcc8 tempest-TaggedBootDevicesTest_v242-209704149 None] Connection info returned from driver {'name': 'volumes/volume-90b790f4-4687-48d2-96c5-c007915fee58', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '90b790f4-4687-48d2-96c5-c007915fee58', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c80ee429-e77d-4324-9f14-d00d9cf304ab'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:15:57.342477 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-ffb48131-93a3-4089-be90-9be05dbdfcc8 tempest-TaggedBootDevicesTest_v242-209704149 None] attachment_update completed successfully. Nov 13 21:15:58.203834 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-b246d971-6d4f-482c-9b59-83f0fc45bf7e tempest-TaggedBootDevicesTest_v242-209704149 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:15:59.155519 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-db79a199-0706-40eb-9e06-eb964144568e req-b246d971-6d4f-482c-9b59-83f0fc45bf7e tempest-TaggedBootDevicesTest_v242-209704149 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.951s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:15:59.157427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-db79a199-0706-40eb-9e06-eb964144568e req-b246d971-6d4f-482c-9b59-83f0fc45bf7e tempest-TaggedBootDevicesTest_v242-209704149 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:15:59.257368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-b246d971-6d4f-482c-9b59-83f0fc45bf7e tempest-TaggedBootDevicesTest_v242-209704149 None] Connection info returned from driver {'name': 'volumes/volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ae00dcaf-50d7-4b31-8fe3-5de55a83bba9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '55439f22-6d20-45c6-ae0f-6e78078f77d5'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:15:59.379413 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-db79a199-0706-40eb-9e06-eb964144568e req-b246d971-6d4f-482c-9b59-83f0fc45bf7e tempest-TaggedBootDevicesTest_v242-209704149 None] attachment_update completed successfully. Nov 13 21:16:17.882934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:16:17.890272 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:16:17.890782 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:16:17.907560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Flow 'volume_create_manager' (599f6320-5824-498a-a08b-e8801fc9fac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:16:17.911597 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e672a584-c111-45d7-a8b7-4ec672fa1f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:17.919168 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:16:17.934093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e672a584-c111-45d7-a8b7-4ec672fa1f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-991161367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f69fbcde-5ee3-469e-a906-37ca39c38cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37aab10891e34756a80155b64a44d100',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:16:18Z,use_quota=True,user_id='6e10911229e643d48e958a6d9d44a19d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:17.937352 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7318ce7c-028f-4189-88d2-89dabb0efb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:17.940506 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7318ce7c-028f-4189-88d2-89dabb0efb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:17.943741 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324c8da5-e785-4f82-aa45-f224b9ac4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:17.947033 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324c8da5-e785-4f82-aa45-f224b9ac4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69fbcde-5ee3-469e-a906-37ca39c38cb1', 'volume_name': 'volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:17.949307 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77781f3-8682-4d76-8855-9e98ed1e6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:17.951452 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77781f3-8682-4d76-8855-9e98ed1e6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:17.953735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2277f692-079f-4bf6-8f5d-fe4f6cb05713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:17.954515 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Volume f69fbcde-5ee3-469e-a906-37ca39c38cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1', 'volume_size': 1} Nov 13 21:16:17.954926 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] creating volume 'volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:16:17.956554 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:18.066136 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:16:18.067333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:18.112119 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:18.147075 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:16:19.855204 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:16:19.855858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:16:19.858077 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2277f692-079f-4bf6-8f5d-fe4f6cb05713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:19.860628 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af78ebf0-0ceb-4733-86b5-ca10dcc21465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:19.988916 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Volume volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1 (f69fbcde-5ee3-469e-a906-37ca39c38cb1): created successfully Nov 13 21:16:19.992223 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af78ebf0-0ceb-4733-86b5-ca10dcc21465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:19.997658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Flow 'volume_create_manager' (599f6320-5824-498a-a08b-e8801fc9fac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:16:20.189779 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-50d09177-9e69-4a86-a7d8-bc400f04943b req-c869ba51-caf9-4157-923c-85bb3fa3e009 tempest-VolumesSnapshotsTestJSON-1328354909 None] Created volume successfully. Nov 13 21:16:21.155784 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-877b85b2-74db-47a4-a7a1-ce92eaeadb99 req-a006d70d-f281-4148-ae5e-c10a041c3cd9 tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:25.288156 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-877b85b2-74db-47a4-a7a1-ce92eaeadb99 req-a006d70d-f281-4148-ae5e-c10a041c3cd9 tempest-VolumesSnapshotsTestJSON-1328354909 None] Create snapshot completed successfully Nov 13 21:16:25.564417 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] Lock "b'cinder-8f1aec36-588c-47d4-b552-fffc3be82895-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.023s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:16:25.568723 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:30.120877 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:16:30.321215 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] Created reservations ['b97fc1a2-f64d-4b54-8994-69573bcb3c59', 'b1513c42-e4d1-4c05-8c86-7f027c207fd6', '0caebd42-e802-4e7a-8b1e-cad87bc63564', 'e5419d6b-cf18-4ab8-8396-8499464c5375'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:16:30.537006 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] Delete snapshot completed successfully. Nov 13 21:16:30.548739 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-e3ff8d68-eaed-4807-b91b-1da51b86ee9b req-45d5bbb0-ec0c-470e-8194-19a66f3f1e55 tempest-VolumesSnapshotsTestJSON-1328354909 None] Lock "b'cinder-8f1aec36-588c-47d4-b552-fffc3be82895-delete_snapshot'" released by "delete_snapshot" :: held 4.984s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:16:31.515413 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Lock "b'cinder-f69fbcde-5ee3-469e-a906-37ca39c38cb1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:16:31.673701 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:31.925199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:16:31.925920 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Volume volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:16:32.178057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] deleting rbd volume volume-f69fbcde-5ee3-469e-a906-37ca39c38cb1 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:16:38.383441 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Created reservations ['dc222f96-995c-47cb-91a5-2af4ac87e056', '27ba0a63-11ee-4714-9944-66b784346026', '95007795-8224-4eec-bf13-c6064993a3d2', 'fda050b9-aaf4-48ae-94c9-6a474ce052da'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:16:38.477792 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6e17d9a2-0066-4452-af28-15852ad2bd2f tempest-GroupsV314Test-1436284398 None] Group tempest-GroupsV314Test-Group-1556425576: creating Nov 13 21:16:38.691759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:38.719888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:38.761454 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:16:38.767340 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6e17d9a2-0066-4452-af28-15852ad2bd2f tempest-GroupsV314Test-1436284398 None] Group tempest-GroupsV314Test-Group-1556425576: created successfully Nov 13 21:16:38.772070 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Deleted volume successfully. Nov 13 21:16:38.791374 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6e17d9a2-0066-4452-af28-15852ad2bd2f tempest-GroupsV314Test-1436284398 None] Create group completed successfully. Nov 13 21:16:38.877931 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-2a376340-3fc6-48df-bde3-61ea3e2b9f32 req-a876628d-2795-42bb-bbd0-de936991fa9d tempest-VolumesSnapshotsTestJSON-1328354909 None] Lock "b'cinder-f69fbcde-5ee3-469e-a906-37ca39c38cb1-delete_volume'" released by "delete_volume" :: held 7.364s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:16:40.773841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:16:40.777546 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:16:40.778127 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:16:40.791044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Flow 'volume_create_manager' (d88184cd-1560-4a1b-8e28-3e1edd8d0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:16:40.795344 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec22a7d3-abd5-41ca-9919-baa652cb800c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:40.802025 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:16:40.817226 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec22a7d3-abd5-41ca-9919-baa652cb800c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1690715665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d17b3cf1-b203-41c7-862a-07c63718c862,host='ncdv-master-1@ceph#ceph',id=725e69d1-a2e4-437b-803c-7e00cfad6cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f1482c430d24630aaa8c8da5e3372d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:16:40Z,use_quota=True,user_id='10ec19cadd2b4d718cf4bbfa2bd8a8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b364049e-aa9e-4fac-8d90-ec2f9c0dd8cb),volume_type_id=b364049e-aa9e-4fac-8d90-ec2f9c0dd8cb)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:40.820308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200167ad-c185-4b35-98f3-2605339789a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:40.829332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200167ad-c185-4b35-98f3-2605339789a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:40.829332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36405e3a-33cd-4fed-8521-9e8ba7c538f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:40.829332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36405e3a-33cd-4fed-8521-9e8ba7c538f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '725e69d1-a2e4-437b-803c-7e00cfad6cb7', 'volume_name': 'volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:40.831162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bfb903-0276-4b8e-b0e6-11dc94910a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:40.845230 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29bfb903-0276-4b8e-b0e6-11dc94910a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:40.852902 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0eecf-855a-4fd9-bff0-a606d65bf818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:40.911329 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Volume 725e69d1-a2e4-437b-803c-7e00cfad6cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7', 'volume_size': 1} Nov 13 21:16:40.912109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] creating volume 'volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:16:40.915099 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:42.106276 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:16:42.107505 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:16:42.110147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91f0eecf-855a-4fd9-bff0-a606d65bf818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:42.112368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3f8236-4021-44e2-b6fe-ac03d4b5e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:16:42.177795 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Volume volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7 (725e69d1-a2e4-437b-803c-7e00cfad6cb7): created successfully Nov 13 21:16:42.183018 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3f8236-4021-44e2-b6fe-ac03d4b5e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:16:42.195235 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Flow 'volume_create_manager' (d88184cd-1560-4a1b-8e28-3e1edd8d0c58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:16:42.256754 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-77c9b16d-8941-4add-ab81-bfe087324c68 tempest-GroupsV314Test-1436284398 None] Created volume successfully. Nov 13 21:16:43.815075 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:44.131932 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] creating snapshot='volume-bf728405-100c-473b-878c-6723e06334f3.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:16:45.995674 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] cloning 'volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7@volume-bf728405-100c-473b-878c-6723e06334f3.clone_snap' to 'volume-bf728405-100c-473b-878c-6723e06334f3' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:16:48.549605 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] Volume volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:16:48.557900 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:16:48.558324 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:16:49.434373 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:16:49.937760 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a3a7f171-9ad6-4588-aa17-97d445771fbf tempest-GroupsV314Test-1436284398 None] Create group from source-group-d17b3cf1-b203-41c7-862a-07c63718c862 completed successfully. Nov 13 21:16:50.975395 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:16:51.307892 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:16:51.657603 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] deleting rbd volume volume-bf728405-100c-473b-878c-6723e06334f3 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:16:59.567825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:16:59.857302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Volume volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:16:59.860998 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] deleting parent snapshot volume-bf728405-100c-473b-878c-6723e06334f3.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:17:04.187492 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Created reservations ['91a6e17d-eada-4523-8665-69eb42f26c34'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:17:04.207029 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-74886160 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-74886160, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:17:04.207979 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-74886160 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-74886160, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:17:04.296404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Created reservations ['d69cdffa-c652-4c55-8ae3-fdb69c912c7c', '988ef98d-41d1-4cbe-b99d-ccfb8d6434ef', '14e82a21-837a-4509-9d2a-bf1c0b67f582', 'e96cd48f-3756-4a82-b168-9e6506aab4fe'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:17:04.865562 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:04.888955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:04.914441 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:17:04.919171 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ea73e194-2058-4171-b08b-9df0ca481ef7 tempest-GroupsV314Test-1436284398 None] Delete group completed successfully. Nov 13 21:17:05.000275 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:17:05.004054 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:17:05.004506 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:17:05.021756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Flow 'volume_create_manager' (c7635bea-3439-4e05-b57e-225c2465cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:17:05.024981 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fe43ec-9836-41bc-a1c5-33c005c7b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:05.031280 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:17:05.048434 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32fe43ec-9836-41bc-a1c5-33c005c7b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1346538851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1fddf4cf-07e3-4d75-ad97-92a782bcd0f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5c9c1ed024cb58d69f1ed135ac148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:17:05Z,use_quota=True,user_id='2ef10ff7333243849d414bd4925ba5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:05.050160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b55fec-7216-45fe-b095-5c54e1e9e536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:05.052609 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b55fec-7216-45fe-b095-5c54e1e9e536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:05.054700 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e78b80-19f5-47a1-8a56-ea5cc2cb26f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:05.056918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e78b80-19f5-47a1-8a56-ea5cc2cb26f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'volume_name': 'volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:05.059155 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42910556-df39-4859-805b-acc0e4b08084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:05.063741 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42910556-df39-4859-805b-acc0e4b08084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:05.063741 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f186427a-9e23-42c3-a0e5-5aab49d14236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:05.064532 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Volume 1fddf4cf-07e3-4d75-ad97-92a782bcd0f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'volume_size': 1} Nov 13 21:17:05.064948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] creating volume 'volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:17:05.065992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:05.434091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:05.599240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:17:05.599677 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] Volume volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:17:05.771575 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] deleting rbd volume volume-725e69d1-a2e4-437b-803c-7e00cfad6cb7 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:17:06.105466 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:17:06.105853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:17:06.107863 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f186427a-9e23-42c3-a0e5-5aab49d14236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:06.110304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4a0df-a8f6-43bc-a84b-ef3df0c50ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:06.198797 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Volume volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0 (1fddf4cf-07e3-4d75-ad97-92a782bcd0f0): created successfully Nov 13 21:17:06.200695 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef4a0df-a8f6-43bc-a84b-ef3df0c50ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:06.204109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Flow 'volume_create_manager' (c7635bea-3439-4e05-b57e-225c2465cda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:17:06.280614 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-73899107-305f-44e2-bb99-95db70ffffde tempest-AttachVolumeShelveTestJSON-56663312 None] Created volume successfully. Nov 13 21:17:13.662124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] Created reservations ['ec58024b-83ce-4655-be8b-81831107abaa'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:17:13.795302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] Created reservations ['6e7a22f8-8d02-4732-a8ce-a8d824b2687e', 'a301be9a-4233-4de4-9a43-8a8bc38701ad', '95f067f6-da01-4ce2-a812-028bf2c7bb6a', 'd1949dd3-7cdf-47a4-a488-e47dab964016'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:17:14.267304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:14.334295 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:14.385007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:17:14.397356 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7656b140-7d15-4797-8d4f-fd338958f0c1 tempest-GroupsV314Test-1436284398 None] Delete group completed successfully. Nov 13 21:17:18.065997 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:17:18.066655 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:18.100127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:18.132265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:17:43.183855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:17:43.189100 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:17:43.192159 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:17:43.206719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Flow 'volume_create_manager' (793f5248-458a-4300-bfa1-e723e308c837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:17:43.211340 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da62a8c-e9c9-4b95-a587-d0648b104558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:43.218733 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:17:43.233651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8da62a8c-e9c9-4b95-a587-d0648b104558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1288812166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f628285f-16eb-4b39-b5c6-7e8d058903c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58deb7a51fa64553a7c803dd2a19df30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:17:43Z,use_quota=True,user_id='b617dc50a44546a889c340a542e3a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39cfe9da-9966-4323-9957-8c2b7f6877f1),volume_type_id=39cfe9da-9966-4323-9957-8c2b7f6877f1)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:43.237066 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8341287d-fbd1-4100-b400-3f65e1425ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:43.240359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8341287d-fbd1-4100-b400-3f65e1425ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:43.243820 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed08ac5b-59f6-46c8-aec2-c07c9986ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:43.246824 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed08ac5b-59f6-46c8-aec2-c07c9986ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f628285f-16eb-4b39-b5c6-7e8d058903c4', 'volume_name': 'volume-f628285f-16eb-4b39-b5c6-7e8d058903c4', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:43.249713 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd4b14-b54a-4cd4-8fb0-65be245fd33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:43.252082 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39dd4b14-b54a-4cd4-8fb0-65be245fd33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:43.255164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239187bc-7612-41b0-bf17-a1c2898f644f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:43.256041 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Volume f628285f-16eb-4b39-b5c6-7e8d058903c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f628285f-16eb-4b39-b5c6-7e8d058903c4', 'volume_size': 1} Nov 13 21:17:43.256321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] creating volume 'volume-f628285f-16eb-4b39-b5c6-7e8d058903c4' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:17:43.257517 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:44.401518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:17:44.403781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:17:44.406356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239187bc-7612-41b0-bf17-a1c2898f644f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f628285f-16eb-4b39-b5c6-7e8d058903c4', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:44.414618 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a8703-0cd9-43f3-ba11-5763ba372895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:17:44.510886 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Volume volume-f628285f-16eb-4b39-b5c6-7e8d058903c4 (f628285f-16eb-4b39-b5c6-7e8d058903c4): created successfully Nov 13 21:17:44.513331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a8703-0cd9-43f3-ba11-5763ba372895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:17:44.517998 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Flow 'volume_create_manager' (793f5248-458a-4300-bfa1-e723e308c837) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:17:44.609354 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-33bc1278-cec0-4095-b274-e43d5cdb9bb7 tempest-VolumeTypesTest-1089259603 None] Created volume successfully. Nov 13 21:17:45.756972 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1a5f2bc3-996e-4587-babd-e73267445cb2 req-a2a4a88c-8d1e-48d1-8729-cfbb8539c514 tempest-AttachVolumeShelveTestJSON-56663312 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:17:45.999940 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-29aa1f0b-50ee-4a96-a92c-73102d7d31db tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:46.054577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-29aa1f0b-50ee-4a96-a92c-73102d7d31db tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:46.117341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-29aa1f0b-50ee-4a96-a92c-73102d7d31db tempest-VolumeTypesTest-1089259603 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:17:46.125348 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-29aa1f0b-50ee-4a96-a92c-73102d7d31db tempest-VolumeTypesTest-1089259603 None] Retype volume completed successfully. Nov 13 21:17:46.540962 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1a5f2bc3-996e-4587-babd-e73267445cb2 req-a2a4a88c-8d1e-48d1-8729-cfbb8539c514 tempest-AttachVolumeShelveTestJSON-56663312 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.784s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:17:46.549233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-1a5f2bc3-996e-4587-babd-e73267445cb2 req-a2a4a88c-8d1e-48d1-8729-cfbb8539c514 tempest-AttachVolumeShelveTestJSON-56663312 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:17:46.627189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1a5f2bc3-996e-4587-babd-e73267445cb2 req-a2a4a88c-8d1e-48d1-8729-cfbb8539c514 tempest-AttachVolumeShelveTestJSON-56663312 None] Connection info returned from driver {'name': 'volumes/volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1fddf4cf-07e3-4d75-ad97-92a782bcd0f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7884f9fe-b354-4283-98d7-49f8aa496a39'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:17:46.782974 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1a5f2bc3-996e-4587-babd-e73267445cb2 req-a2a4a88c-8d1e-48d1-8729-cfbb8539c514 tempest-AttachVolumeShelveTestJSON-56663312 None] attachment_update completed successfully. Nov 13 21:17:49.139281 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Lock "b'cinder-f628285f-16eb-4b39-b5c6-7e8d058903c4-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:17:49.306213 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:49.654958 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:17:49.655415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Volume volume-f628285f-16eb-4b39-b5c6-7e8d058903c4 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:17:49.912564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] deleting rbd volume volume-f628285f-16eb-4b39-b5c6-7e8d058903c4 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:17:58.057218 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-2053533346 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-2053533346, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:17:58.058966 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-2053533346 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-2053533346, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:17:58.146093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Created reservations ['320172c5-fe81-4aae-98f2-11579248753f', '94764351-a63f-4a4b-a0e0-3f1886975513', 'ee4015ef-acae-4f72-a514-a240767d6937', 'a20c7279-0ca0-4b6a-b54a-477743eb51ee'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:17:58.723744 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:58.780782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:17:58.891383 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:17:58.898515 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Deleted volume successfully. Nov 13 21:17:59.048378 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-fc221bab-1cb3-400c-83af-a07ddbfc721f tempest-VolumeTypesTest-1089259603 None] Lock "b'cinder-f628285f-16eb-4b39-b5c6-7e8d058903c4-delete_volume'" released by "delete_volume" :: held 9.923s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:18:18.068537 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:18:18.079701 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:18.115022 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:18.156568 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:18:30.686024 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:18:30.692953 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:18:30.692953 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:18:30.705670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (d2b5d535-d2f3-403a-b8f0-7be4e8701ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:30.709560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041834f-d325-45b9-b269-bd4ba2e43691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:30.715983 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:18:30.730203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041834f-d325-45b9-b269-bd4ba2e43691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1487897311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c615929e-3458-49b9-a9a3-26024e9cbdcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:18:30Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:30.732772 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ca159-d6b3-4386-8b17-3a22146c7aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:30.737188 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8ca159-d6b3-4386-8b17-3a22146c7aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:30.737907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea1026a-73e8-4652-b6ef-b5fd3469da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:30.740126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea1026a-73e8-4652-b6ef-b5fd3469da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c615929e-3458-49b9-a9a3-26024e9cbdcd', 'volume_name': 'volume-c615929e-3458-49b9-a9a3-26024e9cbdcd', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:30.742834 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589c874f-5a33-4b13-bd38-277691ba370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:30.744967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (589c874f-5a33-4b13-bd38-277691ba370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:30.747161 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19716dcf-2461-4593-be84-8a511bf554f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:30.747970 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Volume c615929e-3458-49b9-a9a3-26024e9cbdcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c615929e-3458-49b9-a9a3-26024e9cbdcd', 'volume_size': 1} Nov 13 21:18:30.748359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-c615929e-3458-49b9-a9a3-26024e9cbdcd' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:18:30.749595 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:32.388991 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:18:32.390349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:18:32.394240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19716dcf-2461-4593-be84-8a511bf554f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c615929e-3458-49b9-a9a3-26024e9cbdcd', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:32.397394 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf47abb-2e48-4561-b781-5133d96cdccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:32.482386 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Volume volume-c615929e-3458-49b9-a9a3-26024e9cbdcd (c615929e-3458-49b9-a9a3-26024e9cbdcd): created successfully Nov 13 21:18:32.486664 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf47abb-2e48-4561-b781-5133d96cdccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:32.491048 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (d2b5d535-d2f3-403a-b8f0-7be4e8701ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:32.598214 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1ae4a27a-107b-4abe-a97a-c6d48f815d01 tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:18:33.758755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-bc7f6ac0-35a9-44ad-8211-586a10311644 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd'" acquired by "attach_volume" :: waited 0.023s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:18:33.990888 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bc7f6ac0-35a9-44ad-8211-586a10311644 tempest-VolumesActionsTest-1736934617 None] Attaching volume c615929e-3458-49b9-a9a3-26024e9cbdcd to instance 3e49a95b-4f9d-49ce-b434-ca20179abf44 at mountpoint /dev/sdb on host None. Nov 13 21:18:34.123092 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bc7f6ac0-35a9-44ad-8211-586a10311644 tempest-VolumesActionsTest-1736934617 None] Attach volume completed successfully. Nov 13 21:18:34.129335 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-bc7f6ac0-35a9-44ad-8211-586a10311644 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd'" released by "attach_volume" :: held 0.371s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:18:34.964989 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-db60c048-6b10-440f-bf9a-324933477c2f tempest-VolumesActionsTest-2130883133 None] Terminate volume connection completed successfully. Nov 13 21:18:35.016125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-db60c048-6b10-440f-bf9a-324933477c2f tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-detach_volume'" acquired by "detach_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:18:35.035102 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-db60c048-6b10-440f-bf9a-324933477c2f tempest-VolumesActionsTest-2130883133 None] Detaching volume c615929e-3458-49b9-a9a3-26024e9cbdcd from instance 3e49a95b-4f9d-49ce-b434-ca20179abf44. Nov 13 21:18:35.236535 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-db60c048-6b10-440f-bf9a-324933477c2f tempest-VolumesActionsTest-2130883133 None] Detach volume completed successfully. Nov 13 21:18:35.241755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-db60c048-6b10-440f-bf9a-324933477c2f tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-detach_volume'" released by "detach_volume" :: held 0.226s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:18:35.484152 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ce429697-edf8-4f56-b89b-a91a7b0785cf tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:18:35.484571 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ce429697-edf8-4f56-b89b-a91a7b0785cf tempest-VolumesActionsTest-1736934617 None] Volume detach called, but volume not attached. Nov 13 21:18:35.515731 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ce429697-edf8-4f56-b89b-a91a7b0785cf tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-detach_volume'" released by "detach_volume" :: held 0.032s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:18:41.472627 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:18:41.475991 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:18:41.476675 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:18:41.488459 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (615e8cef-f6c6-4417-bab9-0c500dd7e9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:41.492669 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da24bd02-ed02-4656-a5e0-08c0a1008cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:41.501636 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:18:41.518648 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da24bd02-ed02-4656-a5e0-08c0a1008cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1356921130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:18:41Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:41.522458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a0cec-0ca2-47e2-b503-34668d69b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:41.525638 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090a0cec-0ca2-47e2-b503-34668d69b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:41.528250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a836109e-5b87-4f99-9851-40d845a04b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:41.531137 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a836109e-5b87-4f99-9851-40d845a04b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b', 'volume_name': 'volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:41.533680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06333c-d85b-4008-b31b-c6c2b4c0b438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:41.535918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b06333c-d85b-4008-b31b-c6c2b4c0b438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:41.538155 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c7e416-8d8e-401c-9b81-18f840e676b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:41.538929 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Volume 0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b', 'volume_size': 1} Nov 13 21:18:41.539333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:18:41.543797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:42.822660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:18:42.823329 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:18:42.825552 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1c7e416-8d8e-401c-9b81-18f840e676b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:42.829393 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0548b7-d91a-462f-944e-5549926046ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:42.910253 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Volume volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b (0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b): created successfully Nov 13 21:18:42.918355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0548b7-d91a-462f-944e-5549926046ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:42.918355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (615e8cef-f6c6-4417-bab9-0c500dd7e9b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:43.041510 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8d83422d-32f3-481e-a34c-d4b2d36db5d7 tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:18:43.992797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:18:44.107715 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:44.956344 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:18:44.957009 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Volume volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:18:45.249456 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] deleting rbd volume volume-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:18:47.125533 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-71bb8ced-631e-4f88-96fa-1f65a43b6435 req-773601d5-9cfb-4bad-a518-af9525b4d12d tempest-AttachVolumeShelveTestJSON-56663312 None] Terminate volume connection completed successfully. Nov 13 21:18:47.130985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-71bb8ced-631e-4f88-96fa-1f65a43b6435 req-773601d5-9cfb-4bad-a518-af9525b4d12d tempest-AttachVolumeShelveTestJSON-56663312 None] Deleting attachment 7884f9fe-b354-4283-98d7-49f8aa496a39. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:18:54.413004 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Created reservations ['5cc4693a-0672-4f48-801b-16478542f1f0', 'cef281b5-cb17-4f60-9364-a7ef90298865', 'c46b522c-d8a7-4508-8436-264a21505f1f', '53972a88-cdfa-401a-a4da-4c610cd59e0a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:18:54.626081 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:54.679200 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:54.747699 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:18:54.754680 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Deleted volume successfully. Nov 13 21:18:54.830749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e2b6846c-063b-411d-a1c3-4e4b92e0e310 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-0ac8aafa-1e6a-446b-aa46-6fb5bf7e1c1b-delete_volume'" released by "delete_volume" :: held 10.838s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:18:55.815057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:18:55.818333 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:18:55.818807 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:18:55.830436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (e97fc162-348d-4b0b-aecf-cd1d6802a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:55.833835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e198a2f6-a9fa-464e-a663-5c18883a56c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:55.839589 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:18:55.851756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e198a2f6-a9fa-464e-a663-5c18883a56c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1425965671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:18:56Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:55.854563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024c7f32-5a8a-4097-834f-94cca78efae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:55.856721 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024c7f32-5a8a-4097-834f-94cca78efae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:55.859074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd933695-9c20-4a39-b6c3-4d73b8180ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:55.861846 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd933695-9c20-4a39-b6c3-4d73b8180ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375', 'volume_name': 'volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:55.864150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de2c2bf-d24c-4aed-8802-35f02f34733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:55.866245 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de2c2bf-d24c-4aed-8802-35f02f34733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:55.868648 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a68e90-3ed9-404a-8250-98d73a9369ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:55.869451 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Volume 7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375', 'volume_size': 1} Nov 13 21:18:55.869848 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:18:55.870850 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:56.920580 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:18:56.922784 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:18:56.924582 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95a68e90-3ed9-404a-8250-98d73a9369ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:56.927226 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1a3cd9-c352-44c0-8e91-d5a948bcdfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:18:57.070571 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Volume volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375 (7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375): created successfully Nov 13 21:18:57.072886 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe1a3cd9-c352-44c0-8e91-d5a948bcdfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:18:57.077752 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (e97fc162-348d-4b0b-aecf-cd1d6802a20e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:18:57.178755 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e685bec1-c69a-4343-8339-87ba51ce022b tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:18:58.176882 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:18:58.310461 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:18:58.625955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:18:58.626396 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Volume volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:18:59.059016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] deleting rbd volume volume-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:19:08.530529 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Created reservations ['73bf7f9f-2897-4ec7-829c-fda05f7dfbbb', '7c1bc952-213a-446c-93c7-f8a89d16d610', 'b5bddbe4-7fa5-41ac-b6d7-1fd08958e5b3', '12053b17-77dd-4896-a41c-8a534caee586'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:19:08.762816 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:08.847700 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:09.004944 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:19:09.012933 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Deleted volume successfully. Nov 13 21:19:09.130890 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-73475d5a-3df3-4862-914f-18b9414ca627 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-7c0ec7ae-9e3b-43c6-a6b0-ccf4e4602375-delete_volume'" released by "delete_volume" :: held 10.954s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:19:10.283200 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:19:10.287792 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:19:10.296335 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:19:10.300678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (53ac29de-772a-486d-b476-95d25253e9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:10.304025 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafd0568-71c0-4e95-bad2-10aad1604fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:10.311162 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:19:10.324572 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fafd0568-71c0-4e95-bad2-10aad1604fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1054166721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eb1eed80-5657-494b-926c-368a668bb312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:19:10Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:10.327386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367c9b88-ebf2-4cd5-ad6c-70b05f329867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:10.331955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367c9b88-ebf2-4cd5-ad6c-70b05f329867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:10.331955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51b51aa-e6ca-4501-80da-794e34266f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:10.334201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a51b51aa-e6ca-4501-80da-794e34266f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb1eed80-5657-494b-926c-368a668bb312', 'volume_name': 'volume-eb1eed80-5657-494b-926c-368a668bb312', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:10.336504 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe0b7d4-b4be-4844-91ca-7fd7008b907d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:10.338747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe0b7d4-b4be-4844-91ca-7fd7008b907d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:10.340987 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f3906c-e860-4971-ac20-97515a4ad420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:10.341798 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Volume eb1eed80-5657-494b-926c-368a668bb312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb1eed80-5657-494b-926c-368a668bb312', 'volume_size': 1} Nov 13 21:19:10.342193 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-eb1eed80-5657-494b-926c-368a668bb312' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:19:10.343222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:12.152947 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:19:12.153623 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:19:12.155205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f3906c-e860-4971-ac20-97515a4ad420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb1eed80-5657-494b-926c-368a668bb312', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:12.157903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b798144d-82be-4bfa-a3ca-0819007a4ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:12.309803 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Volume volume-eb1eed80-5657-494b-926c-368a668bb312 (eb1eed80-5657-494b-926c-368a668bb312): created successfully Nov 13 21:19:12.311721 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b798144d-82be-4bfa-a3ca-0819007a4ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:12.317532 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (53ac29de-772a-486d-b476-95d25253e9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:12.423763 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0f946e5c-9657-43c3-bd13-085fc29b33bb tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:19:13.933785 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-eb1eed80-5657-494b-926c-368a668bb312-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:19:14.119856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:14.559201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:19:14.559201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Volume volume-eb1eed80-5657-494b-926c-368a668bb312 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:19:14.928247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] deleting rbd volume volume-eb1eed80-5657-494b-926c-368a668bb312 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:19:18.068418 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:19:18.070484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:18.115762 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:18.148165 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:19:25.347017 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Created reservations ['58eb1efc-fb66-4144-9055-593e7162eb77', '5de3bfa6-adc0-4146-bd09-f9b4a66c8bcf', '6f032845-d783-4073-aa77-2360df1453d4', 'adefd7c2-c185-41f4-8598-e2fa160d06ed'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:19:25.532920 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:25.627725 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:25.673182 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:19:25.679353 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Deleted volume successfully. Nov 13 21:19:25.827851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ab3de42e-acc8-4a1d-bbea-8f537fc782f3 tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-eb1eed80-5657-494b-926c-368a668bb312-delete_volume'" released by "delete_volume" :: held 11.854s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:19:27.465531 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:19:27.476805 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:19:27.476805 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:19:27.494248 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (7d55f743-e267-45a1-bd9d-2b5af691660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:27.497774 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27bb5f-6df6-4f54-acfd-0759211ce95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:27.504458 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:19:27.523873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27bb5f-6df6-4f54-acfd-0759211ce95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-708852929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1f17dee-4c4b-40e9-8ae4-a4163be4ec04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:19:27Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:27.528331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd8ab8f-49e6-46f2-af09-aba7fa079f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:27.535709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd8ab8f-49e6-46f2-af09-aba7fa079f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:27.540718 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e4cc74-b3f0-4c62-8122-eda8c0278fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:27.544672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2e4cc74-b3f0-4c62-8122-eda8c0278fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1f17dee-4c4b-40e9-8ae4-a4163be4ec04', 'volume_name': 'volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:27.547981 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830efaf2-9c62-4122-b068-eaaa3e264021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:27.550545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830efaf2-9c62-4122-b068-eaaa3e264021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:27.552885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46672a3-3c0a-4c0b-b0ca-609c4c0f3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:27.553685 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Volume c1f17dee-4c4b-40e9-8ae4-a4163be4ec04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04', 'volume_size': 1} Nov 13 21:19:27.554109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:19:27.555286 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:29.359767 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:19:29.364511 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:19:29.364511 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a46672a3-3c0a-4c0b-b0ca-609c4c0f3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:29.364511 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1de20ea-2827-4e0d-8ead-3d4189824b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:29.486753 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Volume volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04 (c1f17dee-4c4b-40e9-8ae4-a4163be4ec04): created successfully Nov 13 21:19:29.489625 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1de20ea-2827-4e0d-8ead-3d4189824b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:29.492823 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (7d55f743-e267-45a1-bd9d-2b5af691660d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:29.646091 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bb87f4c0-a898-4e35-93e3-8dd7491d605b tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:19:30.955386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:19:31.133959 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:31.637508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:19:31.637934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Volume volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:19:32.631427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] deleting rbd volume volume-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:19:43.303085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Created reservations ['ab89d7b2-31c5-4c74-9903-91cdcb31cc69', '4ce77513-04f6-4327-9cb9-3bbaa769fa1b', '8c947d80-f847-4636-8796-93749f00da9e', 'd0ffe063-ec99-4764-a967-1341f2d32cce'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:19:43.494755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:43.551647 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:43.600230 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:19:43.604484 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Deleted volume successfully. Nov 13 21:19:43.758798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5f4a52e2-ec01-44c8-ac5f-4ec247b18c2a tempest-VolumesActionsTest-2130883133 None] Lock "b'cinder-c1f17dee-4c4b-40e9-8ae4-a4163be4ec04-delete_volume'" released by "delete_volume" :: held 12.803s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:19:45.276263 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:19:45.287899 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:19:45.287899 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:19:45.299121 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (8434c6ff-d97f-48f0-9186-0988535975ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:45.302247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d20f9-e014-41d9-a12f-715217cd0261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:45.309384 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:19:45.322433 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (252d20f9-e014-41d9-a12f-715217cd0261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:19:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-328923987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=03923f90-5f84-4e93-926e-6ca72db4790b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b110044c736248adbfae21f2a52dad64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:19:45Z,use_quota=True,user_id='d169d65a691a4666852825318bcb2925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:45.345243 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b805019d-4b2e-4eff-910e-ea056593b4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:45.345243 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b805019d-4b2e-4eff-910e-ea056593b4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:45.345243 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4ee66-15d8-4e59-825d-c61d3b191a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:45.346051 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f4ee66-15d8-4e59-825d-c61d3b191a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03923f90-5f84-4e93-926e-6ca72db4790b', 'volume_name': 'volume-03923f90-5f84-4e93-926e-6ca72db4790b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:45.346051 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6b71ef-a31f-4816-9b9c-8c7bae6db122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:45.346051 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d6b71ef-a31f-4816-9b9c-8c7bae6db122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:45.346377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87edc4bc-dc5b-4011-afc8-88eeda8458fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:45.346377 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Volume 03923f90-5f84-4e93-926e-6ca72db4790b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03923f90-5f84-4e93-926e-6ca72db4790b', 'volume_size': 1} Nov 13 21:19:45.346377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] creating volume 'volume-03923f90-5f84-4e93-926e-6ca72db4790b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:19:45.346377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:46.844013 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:19:46.845021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:19:46.846675 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87edc4bc-dc5b-4011-afc8-88eeda8458fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03923f90-5f84-4e93-926e-6ca72db4790b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:46.848965 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af831b02-dae1-4a01-9a45-ee7950a70614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:19:47.085578 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Volume volume-03923f90-5f84-4e93-926e-6ca72db4790b (03923f90-5f84-4e93-926e-6ca72db4790b): created successfully Nov 13 21:19:47.087501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af831b02-dae1-4a01-9a45-ee7950a70614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:19:47.112150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Flow 'volume_create_manager' (8434c6ff-d97f-48f0-9186-0988535975ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:19:47.280140 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3d2589d1-7f62-4355-a6c4-990c9f475777 tempest-VolumesActionsTest-1736934617 None] Created volume successfully. Nov 13 21:19:49.303589 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-03923f90-5f84-4e93-926e-6ca72db4790b-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:19:49.421104 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:19:49.943195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:19:49.943815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Volume volume-03923f90-5f84-4e93-926e-6ca72db4790b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:19:50.322380 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] deleting rbd volume volume-03923f90-5f84-4e93-926e-6ca72db4790b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:20:00.749740 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Created reservations ['561204a0-5dd9-42e7-9ebd-b456a8aa06e6', '2360fe40-2683-4880-b31d-bfc8d037f3ea', 'c608117f-9b16-47ab-9bfa-4a64b8bce824', 'da0e5ad5-930c-41e9-b057-c50bdd37d4c8'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:20:00.998557 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:01.142026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:01.197958 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:20:01.204549 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Deleted volume successfully. Nov 13 21:20:01.286544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-606d23f9-9bed-4e36-a50b-854e70065206 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-03923f90-5f84-4e93-926e-6ca72db4790b-delete_volume'" released by "delete_volume" :: held 11.983s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:01.363291 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:20:01.479543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:01.679512 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:20:01.680169 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Volume volume-c615929e-3458-49b9-a9a3-26024e9cbdcd is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:20:01.977368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] deleting rbd volume volume-c615929e-3458-49b9-a9a3-26024e9cbdcd {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:20:06.709615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:20:06.712937 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:20:06.713422 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:20:06.726123 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Flow 'volume_create_manager' (625d44df-ba31-4066-b4c7-ce1cd9a20484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:06.729154 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0d24a-ef50-4065-bf44-963bbba988e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:06.735437 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:20:06.748782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe0d24a-ef50-4065-bf44-963bbba988e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-167273329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b196df3d-ba60-4c82-ac4d-c5fed3f8d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72eed91cd0cd4d859b4a6a9a99b22250',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:20:07Z,use_quota=True,user_id='16322e0afdb34037a22bede9c02c99e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:06.751224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684b0d14-a743-49c5-b1cd-afe5b8627b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:06.753349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684b0d14-a743-49c5-b1cd-afe5b8627b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:06.759460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b275816a-8bf2-4921-8ef8-fcd053d817b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:06.759460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b275816a-8bf2-4921-8ef8-fcd053d817b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b196df3d-ba60-4c82-ac4d-c5fed3f8d320', 'volume_name': 'volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:06.760880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e067aa63-04f9-4c09-8ca2-82b85297be19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:06.762874 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e067aa63-04f9-4c09-8ca2-82b85297be19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:06.765756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009df6c3-8c70-4197-b17c-f49ab9378c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:06.766506 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Volume b196df3d-ba60-4c82-ac4d-c5fed3f8d320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320', 'volume_size': 1} Nov 13 21:20:06.766888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] creating volume 'volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:20:06.767867 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:08.156880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:20:08.157425 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:20:08.160319 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009df6c3-8c70-4197-b17c-f49ab9378c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:08.162699 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b90ae6-1acf-4107-84c5-0cb9850eed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:08.256708 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Volume volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320 (b196df3d-ba60-4c82-ac4d-c5fed3f8d320): created successfully Nov 13 21:20:08.261169 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b90ae6-1acf-4107-84c5-0cb9850eed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:08.261881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Flow 'volume_create_manager' (625d44df-ba31-4066-b4c7-ce1cd9a20484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:08.371277 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3ea29fb5-3335-4e09-a639-610dac4343bf tempest-VolumeQuotasNegativeTestJSON-408863812 None] Created volume successfully. Nov 13 21:20:10.144891 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Lock "b'cinder-b196df3d-ba60-4c82-ac4d-c5fed3f8d320-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:20:10.247992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:10.548878 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:20:10.549807 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Volume volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:20:10.851293 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] deleting rbd volume volume-b196df3d-ba60-4c82-ac4d-c5fed3f8d320 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:20:10.994017 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Created reservations ['780c59ab-a09f-4352-a4f2-455af6a15b96', 'b76647a7-62e0-4319-b1b3-c4c1497ed33b', '7d37f2e6-6f58-4bc0-a4e5-7c84edbc0a15', 'bccab867-f351-405e-b584-18035f1cfabd'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:20:11.263229 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:11.285755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:11.310024 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:20:11.314704 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Deleted volume successfully. Nov 13 21:20:11.404447 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15975e27-229f-47fc-a795-f3b55f74e410 tempest-VolumesActionsTest-1736934617 None] Lock "b'cinder-c615929e-3458-49b9-a9a3-26024e9cbdcd-delete_volume'" released by "delete_volume" :: held 10.041s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:18.069465 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:20:18.071443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:18.144869 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:18.222568 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:20:19.171505 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Created reservations ['e386d88d-8891-41eb-a7e4-bc13f1df5717', '624ffec3-2c78-4def-9048-5279091c5074', '30629969-0642-48b9-b649-7fb047fc3429', '67e9f6b5-3018-4662-b515-ccfc9ee5e350'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:20:19.421792 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:19.555424 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:19.595612 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:20:19.599690 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Deleted volume successfully. Nov 13 21:20:19.742345 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-678d96f9-07c7-4ef6-b6ce-51107bbdf098 tempest-VolumeQuotasNegativeTestJSON-408863812 None] Lock "b'cinder-b196df3d-ba60-4c82-ac4d-c5fed3f8d320-delete_volume'" released by "delete_volume" :: held 9.597s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:19.845050 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:20:19.851112 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:20:19.852163 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:20:19.870261 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Flow 'volume_create_manager' (68f6b365-c77a-4b8b-92aa-340ee99297f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:19.875074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a8c27-abd1-410a-a844-dd0d9244c3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:19.882348 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:20:19.902885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (301a8c27-abd1-410a-a844-dd0d9244c3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-342574560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4fb4938d-a5d6-4f47-a87f-d87998e8123b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7f63d6fdb24883b6a6e42d21fbcd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:20:20Z,use_quota=True,user_id='90ca502a1b1d49b4aa2fce6ae6f41949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:19.907843 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1d1657-a783-451d-9b6a-e8497e99d900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:19.910406 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1d1657-a783-451d-9b6a-e8497e99d900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:19.913759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457a6c5b-19f5-470d-8409-538bf0583e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:19.916515 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (457a6c5b-19f5-470d-8409-538bf0583e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fb4938d-a5d6-4f47-a87f-d87998e8123b', 'volume_name': 'volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:19.920605 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1172f67-50d6-49ce-9289-b83d460e5955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:19.924585 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1172f67-50d6-49ce-9289-b83d460e5955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:19.928382 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eeeb84-f263-4b5a-aec9-1077aa1465d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:19.929477 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Volume 4fb4938d-a5d6-4f47-a87f-d87998e8123b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b', 'volume_size': 1} Nov 13 21:20:19.930047 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] creating volume 'volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:20:19.937232 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:21.289884 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:20:21.291553 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:20:21.294385 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5eeeb84-f263-4b5a-aec9-1077aa1465d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:21.299591 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcc74b6-05a8-4c81-b960-8d8bd8078ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:21.485108 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Volume volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b (4fb4938d-a5d6-4f47-a87f-d87998e8123b): created successfully Nov 13 21:20:21.485108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fcc74b6-05a8-4c81-b960-8d8bd8078ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:21.485108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Flow 'volume_create_manager' (68f6b365-c77a-4b8b-92aa-340ee99297f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:21.613957 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-693961b4-4a75-4945-a882-6eb760fac736 tempest-VolumesActionsTest-1716385289 None] Created volume successfully. Nov 13 21:20:37.750117 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:20:37.754079 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:20:37.754590 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:20:37.767463 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Flow 'volume_create_manager' (19d666df-4666-4ad1-92ef-8fbbf1421004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:37.770692 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b22ca8-100e-4481-8f37-0da92ad8373a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:37.777725 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:20:37.794005 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b22ca8-100e-4481-8f37-0da92ad8373a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-264236664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=093e163c-1144-45a3-9ffa-30baf8a46943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db1e55a404164f6c8f5a8ab6efe84e80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:20:38Z,use_quota=True,user_id='c0384c560702452fa274b817527b5f4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:37.798003 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f993ea-50eb-4410-9b94-842c215db99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:37.800416 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f993ea-50eb-4410-9b94-842c215db99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:37.803056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f892140-2e7f-4fac-9670-261a4c187d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:37.805890 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f892140-2e7f-4fac-9670-261a4c187d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093e163c-1144-45a3-9ffa-30baf8a46943', 'volume_name': 'volume-093e163c-1144-45a3-9ffa-30baf8a46943', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:37.809074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cacd523-1910-4bb0-9d0a-29d742530337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:37.812022 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cacd523-1910-4bb0-9d0a-29d742530337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:37.814605 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a9970d-c5ca-4930-858a-981b154dac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:37.815598 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Volume 093e163c-1144-45a3-9ffa-30baf8a46943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093e163c-1144-45a3-9ffa-30baf8a46943', 'volume_size': 1} Nov 13 21:20:37.816306 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] creating volume 'volume-093e163c-1144-45a3-9ffa-30baf8a46943' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:20:37.818822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:39.464386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:20:39.465755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:20:39.469343 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7a9970d-c5ca-4930-858a-981b154dac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093e163c-1144-45a3-9ffa-30baf8a46943', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:39.471750 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4374b217-ba72-44af-b8c9-e469fdf8d8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:39.582980 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Volume volume-093e163c-1144-45a3-9ffa-30baf8a46943 (093e163c-1144-45a3-9ffa-30baf8a46943): created successfully Nov 13 21:20:39.582980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4374b217-ba72-44af-b8c9-e469fdf8d8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:39.582980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Flow 'volume_create_manager' (19d666df-4666-4ad1-92ef-8fbbf1421004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:39.707015 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2e207fcd-2193-475e-9fbb-8ffa6cbb3a46 tempest-VolumesMetadataTest-1997056028 None] Created volume successfully. Nov 13 21:20:39.885765 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b9c64737-a692-465f-a78e-781543ea97ec tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b'" acquired by "attach_volume" :: waited 0.070s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:20:40.124393 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b9c64737-a692-465f-a78e-781543ea97ec tempest-VolumesActionsTest-1716385289 None] Attaching volume 4fb4938d-a5d6-4f47-a87f-d87998e8123b to instance 5f6e4d3d-8d50-4040-9e84-1778325f0988 at mountpoint /dev/sdb on host None. Nov 13 21:20:40.222183 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b9c64737-a692-465f-a78e-781543ea97ec tempest-VolumesActionsTest-1716385289 None] Attach volume completed successfully. Nov 13 21:20:40.228046 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b9c64737-a692-465f-a78e-781543ea97ec tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b'" released by "attach_volume" :: held 0.348s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:40.440099 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2b44c0e5-27f7-4230-9370-8192a3ea318a tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-detach_volume'" acquired by "detach_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:20:40.440571 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2b44c0e5-27f7-4230-9370-8192a3ea318a tempest-VolumesActionsTest-1716385289 None] Detaching volume 4fb4938d-a5d6-4f47-a87f-d87998e8123b from instance 5f6e4d3d-8d50-4040-9e84-1778325f0988. Nov 13 21:20:40.708267 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2b44c0e5-27f7-4230-9370-8192a3ea318a tempest-VolumesActionsTest-1716385289 None] Detach volume completed successfully. Nov 13 21:20:40.713637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2b44c0e5-27f7-4230-9370-8192a3ea318a tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-detach_volume'" released by "detach_volume" :: held 0.274s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:42.391786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Lock "b'cinder-093e163c-1144-45a3-9ffa-30baf8a46943-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:20:42.507291 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:42.917288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:20:42.918203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Volume volume-093e163c-1144-45a3-9ffa-30baf8a46943 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:20:43.227484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] deleting rbd volume volume-093e163c-1144-45a3-9ffa-30baf8a46943 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:20:52.478740 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Created reservations ['5357b2e1-e3a4-4153-933f-f83763105f3e', '1a1e92f1-e438-4040-85c8-cd6708112acb', '2ad41a9e-eec7-43cc-a608-54042ed8330d', 'afee361e-475a-46f6-aab7-46d54d494d1d'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:20:52.690797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:52.862032 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:52.919420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:20:52.924516 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Deleted volume successfully. Nov 13 21:20:53.044376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d1a99c9f-35a5-4485-a747-db514cfe9188 tempest-VolumesMetadataTest-1997056028 None] Lock "b'cinder-093e163c-1144-45a3-9ffa-30baf8a46943-delete_volume'" released by "delete_volume" :: held 10.652s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:20:54.423158 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:20:54.423158 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:20:54.423864 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:20:54.452007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Flow 'volume_create_manager' (c05daf6a-441f-4445-bf1b-143bbe50efb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:54.458278 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e861b3b-59de-4203-9a39-92a65b4d00f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:54.466234 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:20:54.481122 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e861b3b-59de-4203-9a39-92a65b4d00f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1829077362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cf5c9c1ed024cb58d69f1ed135ac148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:20:54Z,use_quota=True,user_id='2ef10ff7333243849d414bd4925ba5a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:54.483990 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1619f863-6daf-4b96-9c03-cb215a72b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:54.486643 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1619f863-6daf-4b96-9c03-cb215a72b543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:54.489462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcfa420-a16c-48d1-ba6a-79cb44c05118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:54.491880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcfa420-a16c-48d1-ba6a-79cb44c05118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f', 'volume_name': 'volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:54.501109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee88857-ad3a-4125-a87d-fc779b9591ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:54.503618 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ee88857-ad3a-4125-a87d-fc779b9591ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:54.506078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778525d0-2571-428b-a35e-bbcb0e80bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:54.507090 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Volume fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f', 'volume_size': 1} Nov 13 21:20:54.509320 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] creating volume 'volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:20:54.510027 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:20:55.745646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:20:55.746261 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:20:55.748052 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778525d0-2571-428b-a35e-bbcb0e80bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:55.750502 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3583d756-1b8a-4320-8419-f2ed1e7a47b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:20:55.833280 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Volume volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f (fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f): created successfully Nov 13 21:20:55.835107 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3583d756-1b8a-4320-8419-f2ed1e7a47b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:20:55.839056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Flow 'volume_create_manager' (c05daf6a-441f-4445-bf1b-143bbe50efb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:20:55.901261 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2c5750ca-8134-4be4-982f-029290f68017 tempest-AttachVolumeShelveTestJSON-56663312 None] Created volume successfully. Nov 13 21:21:00.713820 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:21:00.717386 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:21:00.717871 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:21:00.730363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (486e7858-e0f2-4d04-8d8b-301ee443a896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:00.733523 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a7908b-a304-4305-a947-a874a08e7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:00.739563 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:21:00.756331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a7908b-a304-4305-a947-a874a08e7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-410952391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c153bc1-b7bd-451c-8f93-eb637acb67b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:21:00Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:00.763931 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bc6110-b5ea-41cc-8cd2-98e0402f98ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:00.766482 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4bc6110-b5ea-41cc-8cd2-98e0402f98ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:00.768887 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8076e-9ef8-4e76-b94b-9a2fa59f0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:00.771100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8076e-9ef8-4e76-b94b-9a2fa59f0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'volume_name': 'volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:00.778044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b12618-aa6c-4f5f-ab24-a10e065cdb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:00.780284 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b12618-aa6c-4f5f-ab24-a10e065cdb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:00.782699 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77665559-1694-43fc-87e9-abea7397e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:00.784856 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume 6c153bc1-b7bd-451c-8f93-eb637acb67b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'volume_size': 1} Nov 13 21:21:00.784856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] creating volume 'volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:21:00.784856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:01.276624 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7601a4d7-a9d6-4225-a2ec-d63997ba4a82 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b'" acquired by "attach_volume" :: waited 0.024s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:21:01.501673 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7601a4d7-a9d6-4225-a2ec-d63997ba4a82 tempest-VolumesActionsTest-1716385289 None] Attaching volume 4fb4938d-a5d6-4f47-a87f-d87998e8123b to instance 80484be8-a453-468c-914e-7d79d2774f5b at mountpoint /dev/sdb on host None. Nov 13 21:21:01.587947 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7601a4d7-a9d6-4225-a2ec-d63997ba4a82 tempest-VolumesActionsTest-1716385289 None] Attach volume completed successfully. Nov 13 21:21:01.596079 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7601a4d7-a9d6-4225-a2ec-d63997ba4a82 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b'" released by "attach_volume" :: held 0.319s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:21:01.770645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f082447-07dc-421e-a9a6-72416706c7d4 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-detach_volume'" acquired by "detach_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:21:01.771737 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7f082447-07dc-421e-a9a6-72416706c7d4 tempest-VolumesActionsTest-1716385289 None] Detaching volume 4fb4938d-a5d6-4f47-a87f-d87998e8123b from instance 80484be8-a453-468c-914e-7d79d2774f5b. Nov 13 21:21:02.040961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:21:02.042852 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:21:02.043959 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77665559-1694-43fc-87e9-abea7397e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:02.050427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd836f0-db6c-4fa1-a1cc-ad68e58667cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:02.057138 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7f082447-07dc-421e-a9a6-72416706c7d4 tempest-VolumesActionsTest-1716385289 None] Detach volume completed successfully. Nov 13 21:21:02.076266 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f082447-07dc-421e-a9a6-72416706c7d4 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-detach_volume'" released by "detach_volume" :: held 0.303s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:21:02.198073 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6 (6c153bc1-b7bd-451c-8f93-eb637acb67b6): created successfully Nov 13 21:21:02.200727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd836f0-db6c-4fa1-a1cc-ad68e58667cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:02.206178 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (486e7858-e0f2-4d04-8d8b-301ee443a896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:02.266804 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ac612f7c-88af-4eee-93a5-4b16c7f5a344 tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:21:03.178497 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7fe116d0-df50-4440-85eb-a9e944ba188d tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:06.849776 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7fe116d0-df50-4440-85eb-a9e944ba188d tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:21:07.894878 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-9a48f483-4955-486f-a400-fa5db6b72660 tempest-VolumesActionsTest-1716385289 None] Running cmd (subprocess): rbd export --pool volumes volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b /opt/stack/data/cinder/conversion/volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b-0e37622e-79e6-449a-9b20-33b543236bce --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:21:08.679360 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-9a48f483-4955-486f-a400-fa5db6b72660 tempest-VolumesActionsTest-1716385289 None] CMD "rbd export --pool volumes volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b /opt/stack/data/cinder/conversion/volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b-0e37622e-79e6-449a-9b20-33b543236bce --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.784s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:21:08.690660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.image_utils [None req-9a48f483-4955-486f-a400-fa5db6b72660 tempest-VolumesActionsTest-1716385289 None] 0e37622e-79e6-449a-9b20-33b543236bce was raw, no need to convert to raw {{(pid=129109) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Nov 13 21:21:11.352844 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.driver [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Creating a new backup for volume volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6. {{(pid=129109) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Nov 13 21:21:11.659379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] cloning volumes/volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6@snapshot-8b66b365-3b56-44a4-b89e-7ba19c51aaf3 to volume-ce7d4f75-34e1-45ad-ab42-18f443b63204 {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:21:11.661120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:11.779546 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:11.825108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:21:11.830893 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:21:11.831924 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:21:11.862510 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Flow 'volume_create_manager' (f7dcf212-c346-4019-aa8e-803f96578256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:11.873041 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b724ac-3e3f-432b-8b47-5c9aea2d52db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:11.883954 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:21:11.914749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b724ac-3e3f-432b-8b47-5c9aea2d52db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1445457842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=873a780d-0fac-4d04-a32a-df6622f96d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c6244b8fd44aa8be6e01661e7358d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:21:11Z,use_quota=True,user_id='787176c2d206483c9cda100a25450679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13ddc77d-9c88-4b8c-818f-126bb45af662),volume_type_id=13ddc77d-9c88-4b8c-818f-126bb45af662)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:11.940915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673cf3b7-b930-426c-8f0e-b7f8ba4fc49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:11.940915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (673cf3b7-b930-426c-8f0e-b7f8ba4fc49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:11.946296 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d08033-5c5b-495e-b0bd-c9e84314d681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:11.952372 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42d08033-5c5b-495e-b0bd-c9e84314d681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873a780d-0fac-4d04-a32a-df6622f96d81', 'volume_name': 'volume-873a780d-0fac-4d04-a32a-df6622f96d81', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:11.966212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dac0c1e-fb94-4a47-82b7-ee67a1c1d078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:11.971563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dac0c1e-fb94-4a47-82b7-ee67a1c1d078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:11.978915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a752f0-c618-4b70-bf70-da5124436cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:11.981487 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Volume 873a780d-0fac-4d04-a32a-df6622f96d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873a780d-0fac-4d04-a32a-df6622f96d81', 'volume_size': 1} Nov 13 21:21:11.983431 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] creating volume 'volume-873a780d-0fac-4d04-a32a-df6622f96d81' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:21:11.984672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:13.968341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:21:13.969167 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:21:13.971011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a752f0-c618-4b70-bf70-da5124436cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873a780d-0fac-4d04-a32a-df6622f96d81', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:13.973237 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f72a37c-077e-41e2-b83e-bc87fedd308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:14.051965 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Volume volume-873a780d-0fac-4d04-a32a-df6622f96d81 (873a780d-0fac-4d04-a32a-df6622f96d81): created successfully Nov 13 21:21:14.056875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f72a37c-077e-41e2-b83e-bc87fedd308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:14.063658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Flow 'volume_create_manager' (f7dcf212-c346-4019-aa8e-803f96578256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:14.136235 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-982d9eeb-98df-422a-8c52-4e065a705aea tempest-VolumeTypesAccessTest-1973631057 None] Created volume successfully. Nov 13 21:21:15.075293 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:21:15.076935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:21:15.084363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:15.179119 ncdv-master-1 cinder-volume[129109]: WARNING cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues Nov 13 21:21:15.392869 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:21:16.095989 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Lock "b'cinder-873a780d-0fac-4d04-a32a-df6622f96d81-delete_volume'" acquired by "delete_volume" :: waited 0.041s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:21:16.378791 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:16.997995 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:21:17.001241 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Volume volume-873a780d-0fac-4d04-a32a-df6622f96d81 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:21:17.609692 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] deleting rbd volume volume-873a780d-0fac-4d04-a32a-df6622f96d81 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:21:17.615636 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.222s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:21:17.616432 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce7d4f75-34e1-45ad-ab42-18f443b63204', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'ce7d4f75-34e1-45ad-ab42-18f443b63204', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:21:17.640060 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Initialize volume connection completed successfully. Nov 13 21:21:18.070108 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:21:18.071061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:18.307265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:18.346147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:21:31.283028 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-129337302 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-129337302, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:21:31.284652 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-129337302 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-129337302, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:21:31.483706 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Created reservations ['640ff39a-0a0b-462b-9497-4e7c8ffde35b', '3b5c6001-57e0-4b11-bda5-ef1272484103', '28194457-79d0-42a2-a4d6-135e0de44caf', '403b800b-a8b0-4087-bf35-a4e8dae38317'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:21:31.970543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:32.029057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:32.109748 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:21:32.117900 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Deleted volume successfully. Nov 13 21:21:32.214656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1f4c8957-1bc4-4614-a9c3-16d5544d9615 tempest-VolumeTypesAccessTest-1973631057 None] Lock "b'cinder-873a780d-0fac-4d04-a32a-df6622f96d81-delete_volume'" released by "delete_volume" :: held 16.119s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:21:36.132815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4a356abe-3856-4a67-ba2b-218e8abc214e req-1312d52e-276d-4b22-9395-ea0cb3eab8cc tempest-AttachVolumeShelveTestJSON-56663312 None] No connector for attachment 3562b048-eb60-4dd8-ab9f-b308f844480b; skipping storage backend terminate_connection call. {{(pid=129109) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4899}} Nov 13 21:21:36.133594 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4a356abe-3856-4a67-ba2b-218e8abc214e req-1312d52e-276d-4b22-9395-ea0cb3eab8cc tempest-AttachVolumeShelveTestJSON-56663312 None] Deleting attachment 3562b048-eb60-4dd8-ab9f-b308f844480b. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:21:39.924707 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9a48f483-4955-486f-a400-fa5db6b72660 tempest-VolumesActionsTest-1716385289 None] Uploaded volume to glance image-id: 0e37622e-79e6-449a-9b20-33b543236bce. {{(pid=129109) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Nov 13 21:21:40.111373 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9a48f483-4955-486f-a400-fa5db6b72660 tempest-VolumesActionsTest-1716385289 None] Copy volume to image completed successfully. Nov 13 21:21:43.405159 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:21:43.437301 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:21:43.441802 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:21:43.442464 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:21:43.456657 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Flow 'volume_create_manager' (560e847b-944a-4dbb-9917-9afbc60df197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:43.460421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88542940-e292-497e-a501-14470f3acf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:43.466672 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:21:43.479868 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88542940-e292-497e-a501-14470f3acf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1432563676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ee77106-a53f-4812-bf79-663ad4a0d2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35a7cb1e92f2413f87f551abf4434090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:21:43Z,use_quota=True,user_id='bd752912df69449191a34962d8c34454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:43.482491 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a177b09e-fba1-48fa-a079-71800fa7fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:43.484528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a177b09e-fba1-48fa-a079-71800fa7fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:43.486873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c00fd1-9af1-4750-9ae6-69be188f7545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:43.489023 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c00fd1-9af1-4750-9ae6-69be188f7545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ee77106-a53f-4812-bf79-663ad4a0d2f3', 'volume_name': 'volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:43.491204 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d875bd6-3e33-4495-a655-ae0ea36eefb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:43.493800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d875bd6-3e33-4495-a655-ae0ea36eefb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:43.496458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d63e64a-02f9-4c79-8e34-dfcf7e75453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:43.497244 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Volume 6ee77106-a53f-4812-bf79-663ad4a0d2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3', 'volume_size': 1} Nov 13 21:21:43.497636 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] creating volume 'volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:21:43.498604 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:43.554934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:43.941098 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:21:43.942523 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Volume volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:21:44.301279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] deleting rbd volume volume-4fb4938d-a5d6-4f47-a87f-d87998e8123b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:21:44.861087 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:21:44.862251 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:21:44.864642 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d63e64a-02f9-4c79-8e34-dfcf7e75453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:44.869953 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6390fa-1470-40e1-ba2d-52d868cdfcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:21:44.975273 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Volume volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3 (6ee77106-a53f-4812-bf79-663ad4a0d2f3): created successfully Nov 13 21:21:44.979433 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf6390fa-1470-40e1-ba2d-52d868cdfcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:21:44.983914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Flow 'volume_create_manager' (560e847b-944a-4dbb-9917-9afbc60df197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:21:45.066254 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f1e994b3-1dac-4878-a904-301095865146 tempest-AbsoluteLimitsTests-2145963171 None] Created volume successfully. Nov 13 21:21:45.709765 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Lock "b'cinder-6ee77106-a53f-4812-bf79-663ad4a0d2f3-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:21:45.833479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:46.123082 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:21:46.124203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Volume volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:21:46.426815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] deleting rbd volume volume-6ee77106-a53f-4812-bf79-663ad4a0d2f3 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:21:57.443061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Created reservations ['007187fa-f4a0-4c9a-ab55-7538771bdbd3', '7ba5025b-894d-4d66-a4de-97fb9eb6f6be', 'e9625346-b857-4b53-b1d0-aae8df7d75a8', 'd7c46994-519a-4661-b2ac-3cc502af5932'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:21:57.780321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:57.847845 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:21:58.047922 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:21:58.052419 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Deleted volume successfully. Nov 13 21:21:58.155567 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f8a87221-2a77-483e-a443-9863f10ad5f3 tempest-VolumesActionsTest-1716385289 None] Lock "b'cinder-4fb4938d-a5d6-4f47-a87f-d87998e8123b-delete_volume'" released by "delete_volume" :: held 14.750s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:22:01.202501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Created reservations ['b1fec30a-9cfc-4ae1-88a3-bba60f5443a0', '9811d197-bd16-4395-97ee-2cc7f0283940', 'c212a311-db9b-422d-9e9c-44b85efcb2b1', 'f6c3dd8e-77a4-44aa-89a4-224ad2258be7'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:22:01.426220 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:01.450790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:01.505867 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:22:01.511992 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Deleted volume successfully. Nov 13 21:22:01.612899 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eecb0cc3-43da-4ec5-a7e8-123d8cc30410 tempest-AbsoluteLimitsTests-2145963171 None] Lock "b'cinder-6ee77106-a53f-4812-bf79-663ad4a0d2f3-delete_volume'" released by "delete_volume" :: held 15.903s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:22:06.855935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:06.860895 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:06.861445 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:06.903686 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (b9c06885-ab03-4838-921f-5fe9c715dc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:06.910669 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87002a30-b59a-44a2-ab08-2c8c26f66cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:06.922755 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:06.940100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87002a30-b59a-44a2-ab08-2c8c26f66cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-634411401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f48410f7-0fe9-445b-a475-d98cc207617a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5565d889c844f068171af7abb316e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:07Z,use_quota=True,user_id='297e478b2861480d9823d4b39ea9004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:06.942956 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f43e1ae-bcce-4a5f-a8c6-e7cc0b6a2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:06.945330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f43e1ae-bcce-4a5f-a8c6-e7cc0b6a2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:06.948007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461cb5b3-34e1-45ca-be56-d853c8f1316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:06.951298 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461cb5b3-34e1-45ca-be56-d853c8f1316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f48410f7-0fe9-445b-a475-d98cc207617a', 'volume_name': 'volume-f48410f7-0fe9-445b-a475-d98cc207617a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:06.954032 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff759c1d-263e-4d7d-a566-125038e129a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:06.956541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff759c1d-263e-4d7d-a566-125038e129a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:06.959076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77ca06a-f408-4274-9dff-cb5b79081e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:06.960246 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Volume f48410f7-0fe9-445b-a475-d98cc207617a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f48410f7-0fe9-445b-a475-d98cc207617a', 'volume_size': 1} Nov 13 21:22:06.960897 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] creating volume 'volume-f48410f7-0fe9-445b-a475-d98cc207617a' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:22:06.972733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:08.689875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:08.690555 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:08.692393 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b77ca06a-f408-4274-9dff-cb5b79081e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f48410f7-0fe9-445b-a475-d98cc207617a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:08.694778 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae21a75-c5d0-4863-bcf9-2e7121f7217d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:08.813662 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Volume volume-f48410f7-0fe9-445b-a475-d98cc207617a (f48410f7-0fe9-445b-a475-d98cc207617a): created successfully Nov 13 21:22:08.815619 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae21a75-c5d0-4863-bcf9-2e7121f7217d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:08.818692 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (b9c06885-ab03-4838-921f-5fe9c715dc96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:08.967978 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4a9fcf45-bbac-48eb-985f-20382e43511e tempest-VolumesListTestJSON-1840979471 None] Created volume successfully. Nov 13 21:22:10.856983 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:10.866150 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:10.866790 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:10.881924 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (d8bc8f55-b118-42fc-8b54-7105d00b1a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:10.886613 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb1f9d2-906a-4433-b8fc-5d2823a71fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:10.894908 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:10.911192 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beb1f9d2-906a-4433-b8fc-5d2823a71fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-578793025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=31d49c77-3138-488f-97a7-1cbc4fe15531,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5565d889c844f068171af7abb316e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:11Z,use_quota=True,user_id='297e478b2861480d9823d4b39ea9004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:10.914787 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818dc0a0-cbad-4ad4-8934-ba67539b6315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:10.926799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818dc0a0-cbad-4ad4-8934-ba67539b6315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:10.929930 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c8a1d-8961-4f6d-bb1c-75de3f77906a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:10.935712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037c8a1d-8961-4f6d-bb1c-75de3f77906a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d49c77-3138-488f-97a7-1cbc4fe15531', 'volume_name': 'volume-31d49c77-3138-488f-97a7-1cbc4fe15531', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:10.941932 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd60664-cea9-4790-bad1-3701efdd8523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:10.962395 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd60664-cea9-4790-bad1-3701efdd8523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:10.967338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7bd016-b9ea-4f41-bb1e-f23dcd145650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:10.968379 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Volume 31d49c77-3138-488f-97a7-1cbc4fe15531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d49c77-3138-488f-97a7-1cbc4fe15531', 'volume_size': 1} Nov 13 21:22:10.968979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] creating volume 'volume-31d49c77-3138-488f-97a7-1cbc4fe15531' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:22:10.970308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:12.528735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:12.530623 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:12.533372 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7bd016-b9ea-4f41-bb1e-f23dcd145650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d49c77-3138-488f-97a7-1cbc4fe15531', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:12.535986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f21cff-9e49-491a-829c-e4f8bb2e909b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:12.675842 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Volume volume-31d49c77-3138-488f-97a7-1cbc4fe15531 (31d49c77-3138-488f-97a7-1cbc4fe15531): created successfully Nov 13 21:22:12.677826 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f21cff-9e49-491a-829c-e4f8bb2e909b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:12.681436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (d8bc8f55-b118-42fc-8b54-7105d00b1a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:12.825399 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9dab589f-2227-4402-bdce-ce2e2ee4d29d tempest-VolumesListTestJSON-1840979471 None] Created volume successfully. Nov 13 21:22:15.408976 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:15.453805 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:15.456008 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:15.487503 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (a822b395-0c43-43c8-bad7-9e2a849c548a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:15.491135 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d91502-a121-40df-a352-5bbd93d70caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:15.498663 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:15.516190 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d91502-a121-40df-a352-5bbd93d70caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-61193074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=89c5feda-cdc5-440d-8e92-61c17427b254,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d5565d889c844f068171af7abb316e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:15Z,use_quota=True,user_id='297e478b2861480d9823d4b39ea9004f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:15.520206 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59bf67-5e20-4e90-afed-fd962a6f7b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:15.522724 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59bf67-5e20-4e90-afed-fd962a6f7b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:15.527693 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d019e5-607b-485b-8098-92240f66eab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:15.544485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d019e5-607b-485b-8098-92240f66eab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c5feda-cdc5-440d-8e92-61c17427b254', 'volume_name': 'volume-89c5feda-cdc5-440d-8e92-61c17427b254', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:15.550247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155c06f7-3bd2-46c3-8290-c0a40c658bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:15.553144 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155c06f7-3bd2-46c3-8290-c0a40c658bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:15.555590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c456d196-e207-4383-9345-b57276cc5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:15.556614 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Volume 89c5feda-cdc5-440d-8e92-61c17427b254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c5feda-cdc5-440d-8e92-61c17427b254', 'volume_size': 1} Nov 13 21:22:15.557032 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] creating volume 'volume-89c5feda-cdc5-440d-8e92-61c17427b254' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:22:15.559369 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:17.930446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:17.931914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:17.934838 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c456d196-e207-4383-9345-b57276cc5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c5feda-cdc5-440d-8e92-61c17427b254', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:17.937719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350bbc98-163e-4613-b5c2-ac5a22ab0370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:18.065209 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:22:18.066260 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:18.134794 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:18.189661 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:22:18.193887 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Volume volume-89c5feda-cdc5-440d-8e92-61c17427b254 (89c5feda-cdc5-440d-8e92-61c17427b254): created successfully Nov 13 21:22:18.197171 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350bbc98-163e-4613-b5c2-ac5a22ab0370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:18.200573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Flow 'volume_create_manager' (a822b395-0c43-43c8-bad7-9e2a849c548a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:18.296856 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2b22e867-4bb9-441a-af89-0b5ccedc03d9 tempest-VolumesListTestJSON-1840979471 None] Created volume successfully. Nov 13 21:22:22.510146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-89c5feda-cdc5-440d-8e92-61c17427b254-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:22:22.623432 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:23.358097 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:22:23.358523 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Volume volume-89c5feda-cdc5-440d-8e92-61c17427b254 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:22:23.783111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] deleting rbd volume volume-89c5feda-cdc5-440d-8e92-61c17427b254 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:22:36.672148 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:36.677782 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:36.678500 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:36.706724 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (ade8c9cb-24fe-4322-80f4-f171d67a744f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:36.721596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e7d24c-165b-48ee-b8a6-90a8c9a4bcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:36.728975 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:36.748940 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e7d24c-165b-48ee-b8a6-90a8c9a4bcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1633577873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d625332a-ae4e-48de-8f45-0bb6ba890ff5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ea687e204c45e5b3f12381c6e825f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:36Z,use_quota=True,user_id='1b338ccedc5e4afcae50493502a4f32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:36.751680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51071425-3701-43cb-92a0-4e7df37f9999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:36.753931 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51071425-3701-43cb-92a0-4e7df37f9999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:36.794013 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b657aa31-03fd-4e23-b774-0c8688390b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:36.891471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b657aa31-03fd-4e23-b774-0c8688390b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd625332a-ae4e-48de-8f45-0bb6ba890ff5', 'volume_name': 'volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:36.894593 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a53296c-c2c8-4db4-9d93-9cb5ef19a73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:36.896965 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a53296c-c2c8-4db4-9d93-9cb5ef19a73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:36.900938 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b1800a-dadd-4b0e-a7ca-21238301d3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:36.905378 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Volume d625332a-ae4e-48de-8f45-0bb6ba890ff5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:22:36.905378 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Cloning d625332a-ae4e-48de-8f45-0bb6ba890ff5 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:22:36.915873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:22:37.075849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 22, 36, 919926)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:22:37.076371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:22:37.077153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:22:37.105021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.166s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:22:37.105021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:22:37.105021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 22, 37, 86825)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:22:37.105021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:22:37.105996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:22:37.105996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:38.621968 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] creating snapshot='volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:22:44.322698 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5.clone_snap' to 'volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:22:44.561680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Created reservations ['58631c7f-bb9e-4946-a5b1-005cc9e461f0', 'fc3c40d1-c890-43d3-9aca-0fe3cee0df98', 'e6ba76c1-2f3d-46aa-b688-06f81208718a', '872f3637-a954-4f69-96e7-e9bd8e1363ed'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:22:44.831189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:44.871820 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:44.965215 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:22:44.977973 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Deleted volume successfully. Nov 13 21:22:45.014387 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-31d49c77-3138-488f-97a7-1cbc4fe15531-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:22:45.091985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0414ba01-61f0-48b0-b8a5-f0805fcbc1d3 tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-89c5feda-cdc5-440d-8e92-61c17427b254-delete_volume'" released by "delete_volume" :: held 22.570s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:22:45.183626 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:45.853748 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:22:45.854551 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Volume volume-31d49c77-3138-488f-97a7-1cbc4fe15531 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:22:46.195969 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] deleting rbd volume volume-31d49c77-3138-488f-97a7-1cbc4fe15531 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:22:46.208946 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Lock "b'cinder-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:22:46.304527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:46.549656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:22:46.549656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Volume volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:22:46.967996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] deleting rbd volume volume-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:22:47.690724 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:22:47.691788 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:47.692185 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:48.773364 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:22:48.774042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Marking volume d625332a-ae4e-48de-8f45-0bb6ba890ff5 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:22:48.875093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to d625332a-ae4e-48de-8f45-0bb6ba890ff5. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:22:48.876667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Creating volume glance metadata for volume d625332a-ae4e-48de-8f45-0bb6ba890ff5 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:22:48.997019 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b1800a-dadd-4b0e-a7ca-21238301d3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:48.999185 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8e2ca7-db2e-4935-942f-3a0b29ff5073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:49.085945 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5 (d625332a-ae4e-48de-8f45-0bb6ba890ff5): created successfully Nov 13 21:22:49.087825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df8e2ca7-db2e-4935-942f-3a0b29ff5073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:49.091592 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (ade8c9cb-24fe-4322-80f4-f171d67a744f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:49.217235 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ef587293-81ff-4292-87f8-bf70075b85c3 tempest-TaggedBootDevicesTest-27436268 None] Created volume successfully. Nov 13 21:22:51.019623 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:51.024351 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:51.024981 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:51.037613 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (008f714b-dd1d-4659-a90d-213a4aeafdf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:51.044911 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0ce610-8934-4fcc-b8fa-ae86614299fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:51.050732 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:51.064195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0ce610-8934-4fcc-b8fa-ae86614299fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1370382896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0f98d81c-d5c9-402b-b67f-dbc7db1d161a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ea687e204c45e5b3f12381c6e825f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:51Z,use_quota=True,user_id='1b338ccedc5e4afcae50493502a4f32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:51.066682 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5454ae27-89e1-4820-b1f9-3bd1a602a1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:51.068741 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5454ae27-89e1-4820-b1f9-3bd1a602a1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:51.071000 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c007a4f-6700-423f-9e55-c3db43ab3a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:51.073851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c007a4f-6700-423f-9e55-c3db43ab3a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'volume_name': 'volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:51.076459 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6242e1f-5cb4-46b5-b469-a4443a6bb793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:51.078770 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6242e1f-5cb4-46b5-b469-a4443a6bb793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:51.080888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8c067-5668-4844-9316-a3737feb7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:51.086339 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Volume 0f98d81c-d5c9-402b-b67f-dbc7db1d161a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'volume_size': 1} Nov 13 21:22:51.086339 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] creating volume 'volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:22:51.086339 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:52.526004 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:52.527089 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:52.529118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc8c067-5668-4844-9316-a3737feb7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:52.531467 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afebd7c8-1437-491a-b6bf-80e376fbdd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:52.686666 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a (0f98d81c-d5c9-402b-b67f-dbc7db1d161a): created successfully Nov 13 21:22:52.693299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afebd7c8-1437-491a-b6bf-80e376fbdd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:52.693299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (008f714b-dd1d-4659-a90d-213a4aeafdf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:52.817044 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a6757fc7-8251-4a37-a9e3-909203c40a32 tempest-TaggedBootDevicesTest-27436268 None] Created volume successfully. Nov 13 21:22:53.696499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:22:53.701023 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:22:53.701510 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:22:53.720030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (56a4620d-7a48-49e6-91c4-b4f452930047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:53.720416 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548a8d69-1f83-4e32-98b6-cbba5d919314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:53.726712 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:22:53.741010 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548a8d69-1f83-4e32-98b6-cbba5d919314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-814783614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e0c5987-8761-4183-9e0a-6f77ec67421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0ea687e204c45e5b3f12381c6e825f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:22:53Z,use_quota=True,user_id='1b338ccedc5e4afcae50493502a4f32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:53.745149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0304ab5c-e745-4a15-b41d-68e29d81ff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:53.747942 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0304ab5c-e745-4a15-b41d-68e29d81ff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:53.750644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f55c2a-4103-4194-8e5d-abc9ddcbaf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:53.754304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f55c2a-4103-4194-8e5d-abc9ddcbaf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e0c5987-8761-4183-9e0a-6f77ec67421c', 'volume_name': 'volume-7e0c5987-8761-4183-9e0a-6f77ec67421c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:53.758755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64774655-f800-4d83-9d64-9ed2a9a85f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:53.767363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64774655-f800-4d83-9d64-9ed2a9a85f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:53.767363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8afb34-5986-4329-b554-802dc2eb3439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:53.767363 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Volume 7e0c5987-8761-4183-9e0a-6f77ec67421c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e0c5987-8761-4183-9e0a-6f77ec67421c', 'volume_size': 1} Nov 13 21:22:53.767363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] creating volume 'volume-7e0c5987-8761-4183-9e0a-6f77ec67421c' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:22:53.767363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:55.417602 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:22:55.418440 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:22:55.420208 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc8afb34-5986-4329-b554-802dc2eb3439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e0c5987-8761-4183-9e0a-6f77ec67421c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:55.422327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a690c1-7393-4a1c-ae54-f024cffcf19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:22:55.555194 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-7e0c5987-8761-4183-9e0a-6f77ec67421c (7e0c5987-8761-4183-9e0a-6f77ec67421c): created successfully Nov 13 21:22:55.555194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a690c1-7393-4a1c-ae54-f024cffcf19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:22:55.555194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Flow 'volume_create_manager' (56a4620d-7a48-49e6-91c4-b4f452930047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:22:55.721562 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bd3d9706-c3de-4686-8447-ea7563801e65 tempest-TaggedBootDevicesTest-27436268 None] Created volume successfully. Nov 13 21:22:59.351395 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Created reservations ['3cd0facb-6e9a-4835-a84a-2026abbce030', '176e1aef-c9e3-4005-adb4-89e790b44918', '7a9f8d1e-5f96-47e1-ac70-dbf6e0148cfd', '504f0a07-2116-4929-852c-b9568c58b5f9'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:22:59.378184 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Created reservations ['a0bd02ef-593a-49ab-9c7a-688c1cc33fd3', '67d2dfdc-075b-4fb3-b16a-69cea4561314', '7b7c409a-10f5-4dc1-a3d0-864fe001f8e8', 'bb572704-35bb-48b9-99bf-57b05beedf05'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:22:59.539306 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:59.610941 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:59.656031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:22:59.662416 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Deleted volume successfully. Nov 13 21:22:59.863914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-932c9f8b-dbe5-4907-913b-33b32c7d0abb tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-31d49c77-3138-488f-97a7-1cbc4fe15531-delete_volume'" released by "delete_volume" :: held 14.845s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:22:59.882896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:22:59.937724 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:00.005786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:23:00.011947 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Deleted volume successfully. Nov 13 21:23:00.102447 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-f48410f7-0fe9-445b-a475-d98cc207617a-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:23:00.146125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-87f863e7-5585-4a5d-bd2a-6d62a9dc5018 tempest-AttachVolumeShelveTestJSON-56663312 None] Lock "b'cinder-fd3b89ca-ee3f-4f1a-aeb2-8aadcc459e8f-delete_volume'" released by "delete_volume" :: held 13.930s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:23:00.250583 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:01.223446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:23:01.225287 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Volume volume-f48410f7-0fe9-445b-a475-d98cc207617a is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:23:01.466212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] deleting rbd volume volume-f48410f7-0fe9-445b-a475-d98cc207617a {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:23:01.494222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Lock "b'cinder-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:23:01.705621 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:02.109850 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:23:02.110722 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Volume volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:23:02.494335 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] deleting rbd volume volume-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:23:14.606478 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Created reservations ['5de9bbd7-d7f5-4279-aae8-7be2b0fceea9', '8a362d5d-17dc-4ffc-9334-1a2e048fa5bb', 'b8e50919-bd1b-4f92-b48f-40f8ec65a650', '3bd6f6b9-eb4b-4c32-866f-9552be9c8a09'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:23:14.938385 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:15.026300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:15.071113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:23:15.082150 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Deleted volume successfully. Nov 13 21:23:15.154332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ca7654ea-dd48-4f33-b79c-332205937c6f tempest-VolumesListTestJSON-1840979471 None] Lock "b'cinder-f48410f7-0fe9-445b-a475-d98cc207617a-delete_volume'" released by "delete_volume" :: held 15.051s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:23:15.557603 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-0e38087d-962a-4461-97a9-7aad04e9154b tempest-TaggedBootDevicesTest-27436268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:23:16.218083 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Created reservations ['a03ba2c4-d7a6-4937-9dac-6ec7602cc41f', '9bf49833-b6e7-4cb1-9a8c-4fb0c2c65c1a', '2ecaf3a2-7617-4010-986c-f9a9f4f0f100', 'bebf162b-9833-40f5-8c94-fbb6b99af9a4'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:23:16.495745 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-0e38087d-962a-4461-97a9-7aad04e9154b tempest-TaggedBootDevicesTest-27436268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.938s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:23:16.496843 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-0e38087d-962a-4461-97a9-7aad04e9154b tempest-TaggedBootDevicesTest-27436268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'd625332a-ae4e-48de-8f45-0bb6ba890ff5', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:23:16.553616 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:16.604880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:16.704186 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:23:16.709688 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Deleted volume successfully. Nov 13 21:23:16.740425 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-0e38087d-962a-4461-97a9-7aad04e9154b tempest-TaggedBootDevicesTest-27436268 None] Connection info returned from driver {'name': 'volumes/volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd625332a-ae4e-48de-8f45-0bb6ba890ff5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8baa784d-db3e-4e2a-9a7b-beda83dd5b7a'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:23:16.744921 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Terminate volume connection completed successfully. Nov 13 21:23:16.770952 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Remove volume export completed successfully. Nov 13 21:23:16.832109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ce7d4f75-34e1-45ad-ab42-18f443b63204-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:23:16.845522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:17.114872 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:23:17.384106 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-ce7d4f75-34e1-45ad-ab42-18f443b63204 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:23:17.439225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-20118f22-93e4-4f95-affb-80d24147a9e4 tempest-AttachVolumeShelveTestJSON-56663312 None] Lock "b'cinder-1fddf4cf-07e3-4d75-ad97-92a782bcd0f0-delete_volume'" released by "delete_volume" :: held 15.945s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:23:17.493376 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-0e38087d-962a-4461-97a9-7aad04e9154b tempest-TaggedBootDevicesTest-27436268 None] attachment_update completed successfully. Nov 13 21:23:18.070098 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:23:18.072090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:18.134821 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:18.225924 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:23:18.407442 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-da43d2da-e601-4463-ac1a-7b5263fcad95 tempest-TaggedBootDevicesTest-27436268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:23:19.527614 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-da43d2da-e601-4463-ac1a-7b5263fcad95 tempest-TaggedBootDevicesTest-27436268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.120s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:23:19.530838 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-da43d2da-e601-4463-ac1a-7b5263fcad95 tempest-TaggedBootDevicesTest-27436268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:23:19.739066 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-da43d2da-e601-4463-ac1a-7b5263fcad95 tempest-TaggedBootDevicesTest-27436268 None] Connection info returned from driver {'name': 'volumes/volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0f98d81c-d5c9-402b-b67f-dbc7db1d161a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ff7f13ec-1dee-4fea-9261-83e23d790a85'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:23:19.922808 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-da43d2da-e601-4463-ac1a-7b5263fcad95 tempest-TaggedBootDevicesTest-27436268 None] attachment_update completed successfully. Nov 13 21:23:20.583646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:23:20.592737 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:23:20.593535 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:23:20.634134 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Flow 'volume_create_manager' (78cc3099-acc4-427e-940b-2dd7f6563d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:23:20.642305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c23c810-dfdc-493d-8122-ba2bd68aceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:20.658817 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:23:20.677922 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c23c810-dfdc-493d-8122-ba2bd68aceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1227298919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=69a08fb4-890c-454f-a0b1-99fd4a26aee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='086b8d0932674db6ba4509370a493494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:23:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:23:20Z,use_quota=True,user_id='ae295e9dfb2d459fb908072aa65f3501',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:20.683935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a02d72-fdb0-437c-8de8-9c025acaccb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:20.697528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a02d72-fdb0-437c-8de8-9c025acaccb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:20.699944 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3564f5-eda5-4bba-9b67-316ba151d8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:20.702259 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3564f5-eda5-4bba-9b67-316ba151d8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69a08fb4-890c-454f-a0b1-99fd4a26aee1', 'volume_name': 'volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:20.704511 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230ea381-692e-4b94-a704-6a1e3a96f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:20.706644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230ea381-692e-4b94-a704-6a1e3a96f988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:20.718115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a546bb9-7f1d-427a-b371-01ff0d10364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:20.718944 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Volume 69a08fb4-890c-454f-a0b1-99fd4a26aee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1', 'volume_size': 1} Nov 13 21:23:20.719357 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] creating volume 'volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:23:20.721428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:20.804168 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-201d774a-7afd-48de-aed1-a40c594c026b tempest-TaggedBootDevicesTest-27436268 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:23:22.112045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:23:22.113645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:23:22.117593 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a546bb9-7f1d-427a-b371-01ff0d10364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:22.122167 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18684e44-e449-4e35-a29e-f6c3be724cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:22.259327 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Volume volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1 (69a08fb4-890c-454f-a0b1-99fd4a26aee1): created successfully Nov 13 21:23:22.264617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18684e44-e449-4e35-a29e-f6c3be724cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:22.270749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Flow 'volume_create_manager' (78cc3099-acc4-427e-940b-2dd7f6563d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:23:22.283371 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-201d774a-7afd-48de-aed1-a40c594c026b tempest-TaggedBootDevicesTest-27436268 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.478s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:23:22.284062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-201d774a-7afd-48de-aed1-a40c594c026b tempest-TaggedBootDevicesTest-27436268 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e0c5987-8761-4183-9e0a-6f77ec67421c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '7e0c5987-8761-4183-9e0a-6f77ec67421c', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:23:22.447513 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-48a21dd5-769e-4217-a0ec-3a66755c2bac tempest-VolumesNegativeTest-1279526454 None] Created volume successfully. Nov 13 21:23:22.501498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-201d774a-7afd-48de-aed1-a40c594c026b tempest-TaggedBootDevicesTest-27436268 None] Connection info returned from driver {'name': 'volumes/volume-7e0c5987-8761-4183-9e0a-6f77ec67421c', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7e0c5987-8761-4183-9e0a-6f77ec67421c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a719a7db-411a-4f03-a2ff-32e87e26584d'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:23:23.035582 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-20ae4f6c-d6e7-4fe8-b8a1-8b3d137662cc req-201d774a-7afd-48de-aed1-a40c594c026b tempest-TaggedBootDevicesTest-27436268 None] attachment_update completed successfully. Nov 13 21:23:27.406111 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:23:27.413353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e5c4ed04-d71a-4b77-b8a0-3ebe09368cfd tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ce7d4f75-34e1-45ad-ab42-18f443b63204-delete_volume'" released by "delete_volume" :: held 10.581s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:23:54.187081 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Lock "b'cinder-69a08fb4-890c-454f-a0b1-99fd4a26aee1-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:23:54.425236 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:54.710107 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:23:54.710712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Volume volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:23:54.954294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] deleting rbd volume volume-69a08fb4-890c-454f-a0b1-99fd4a26aee1 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:23:55.651922 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:23:55.655719 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:23:55.656190 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:23:55.668318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (a3e35b21-002e-465c-b5d0-ee8913973ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:23:55.671379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccaa2749-1840-450d-83a2-5989aedd8ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:55.677668 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:23:55.692285 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccaa2749-1840-450d-83a2-5989aedd8ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1746502883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d74a6083-10e2-4e37-962d-a7a09b64838e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:23:55Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:55.695429 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f668d1bb-b43b-4325-bef2-f3d1b50a4f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:55.697639 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f668d1bb-b43b-4325-bef2-f3d1b50a4f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:55.700771 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b996bfc-3937-4b33-a7fc-91158787bf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:55.785245 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b996bfc-3937-4b33-a7fc-91158787bf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd74a6083-10e2-4e37-962d-a7a09b64838e', 'volume_name': 'volume-d74a6083-10e2-4e37-962d-a7a09b64838e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:55.788161 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee21a0-3254-46c7-b4b9-633cf77ef21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:55.790330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ee21a0-3254-46c7-b4b9-633cf77ef21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:23:55.792517 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ee9f21-8c75-4f11-9465-93a538ced854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:23:55.793353 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Volume d74a6083-10e2-4e37-962d-a7a09b64838e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d74a6083-10e2-4e37-962d-a7a09b64838e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:23:55.793921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Cloning d74a6083-10e2-4e37-962d-a7a09b64838e from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:23:55.803962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:23:55.890540 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 23, 55, 807946)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:23:55.890967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:23:55.891362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:23:55.895945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.092s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:23:55.896893 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:23:55.904164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 23, 55, 900273)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:23:55.904164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:23:55.904164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:23:55.914880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:23:56.232920 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] creating snapshot='volume-d74a6083-10e2-4e37-962d-a7a09b64838e.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:24:00.324623 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-d74a6083-10e2-4e37-962d-a7a09b64838e.clone_snap' to 'volume-d74a6083-10e2-4e37-962d-a7a09b64838e' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:24:03.465352 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:24:03.466577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:24:03.466963 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:24:04.283352 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:24:04.283952 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Marking volume d74a6083-10e2-4e37-962d-a7a09b64838e as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:24:04.399072 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to d74a6083-10e2-4e37-962d-a7a09b64838e. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:24:04.399952 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Creating volume glance metadata for volume d74a6083-10e2-4e37-962d-a7a09b64838e backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:24:04.522910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44ee9f21-8c75-4f11-9465-93a538ced854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74a6083-10e2-4e37-962d-a7a09b64838e', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:24:04.525759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b81ede-fa63-460c-b658-3c2cb4ba8e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:24:04.667739 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-d74a6083-10e2-4e37-962d-a7a09b64838e (d74a6083-10e2-4e37-962d-a7a09b64838e): created successfully Nov 13 21:24:04.669786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b81ede-fa63-460c-b658-3c2cb4ba8e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:24:04.672790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (a3e35b21-002e-465c-b5d0-ee8913973ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:24:04.770792 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1e5b4091-f890-4301-83e1-f0d8ca4c6f1c tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:24:05.016602 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Created reservations ['099e92bf-d582-4d87-82f2-5b0f4b491fcd', '34537e8b-7028-4e14-a4c2-07422cba15a6', '78fb7f59-03ed-46d1-81a4-a67d823a39a6', '9e634b3c-1822-424c-b097-94abce1daec2'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:24:05.267371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:05.291600 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:05.314466 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:24:05.319505 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Deleted volume successfully. Nov 13 21:24:05.426667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-228e14b6-c4a5-4e43-8e10-3d15b21684f4 tempest-VolumesNegativeTest-1279526454 None] Lock "b'cinder-69a08fb4-890c-454f-a0b1-99fd4a26aee1-delete_volume'" released by "delete_volume" :: held 11.242s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:24:06.838064 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-f4ffc0eb-e616-4dc7-b087-d87ec32a467c req-d1b6cabc-727f-4180-bfaa-5f8166ac240d tempest-VolumesSnapshotTestJSON-1404067749 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:24:07.633424 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-f4ffc0eb-e616-4dc7-b087-d87ec32a467c req-d1b6cabc-727f-4180-bfaa-5f8166ac240d tempest-VolumesSnapshotTestJSON-1404067749 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.795s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:24:07.634143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-f4ffc0eb-e616-4dc7-b087-d87ec32a467c req-d1b6cabc-727f-4180-bfaa-5f8166ac240d tempest-VolumesSnapshotTestJSON-1404067749 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d74a6083-10e2-4e37-962d-a7a09b64838e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'd74a6083-10e2-4e37-962d-a7a09b64838e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:24:07.746665 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-f4ffc0eb-e616-4dc7-b087-d87ec32a467c req-d1b6cabc-727f-4180-bfaa-5f8166ac240d tempest-VolumesSnapshotTestJSON-1404067749 None] Connection info returned from driver {'name': 'volumes/volume-d74a6083-10e2-4e37-962d-a7a09b64838e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd74a6083-10e2-4e37-962d-a7a09b64838e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '75f008e2-4c3c-4198-8bec-9de3288a9a48'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:24:07.849145 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-f4ffc0eb-e616-4dc7-b087-d87ec32a467c req-d1b6cabc-727f-4180-bfaa-5f8166ac240d tempest-VolumesSnapshotTestJSON-1404067749 None] attachment_update completed successfully. Nov 13 21:24:11.517763 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-27534de7-6ffa-498d-91c2-943ce71ce213 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:15.254929 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-27534de7-6ffa-498d-91c2-943ce71ce213 tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:24:16.111966 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a430a03e-649f-4b2d-96df-a98b99d07c77 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:18.071258 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:24:18.071972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:18.092992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:18.113685 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:24:19.164439 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a430a03e-649f-4b2d-96df-a98b99d07c77 tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:24:20.751150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fbc45713-9823-4353-b166-541bb5224d58 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:25.859505 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fbc45713-9823-4353-b166-541bb5224d58 tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:24:26.882423 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-97cce538-d8d1-4678-a4cd-0e8567ee5940 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-3dd76d4b-1ef7-4bb5-9302-8e06cf95177a-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:24:26.883994 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-97cce538-d8d1-4678-a4cd-0e8567ee5940 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:24:59.030961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-97cce538-d8d1-4678-a4cd-0e8567ee5940 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['497debac-a13c-415f-81d5-3f0d3670e538', '243efe4e-2fa0-4ee3-b6da-269d824cb447', '7e26a218-911a-48b4-afab-d6281efbf22f', 'a2469f50-098d-4381-a3a9-70c9a28bf28c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:24:59.277248 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-97cce538-d8d1-4678-a4cd-0e8567ee5940 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:24:59.282281 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-97cce538-d8d1-4678-a4cd-0e8567ee5940 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-3dd76d4b-1ef7-4bb5-9302-8e06cf95177a-delete_snapshot'" released by "delete_snapshot" :: held 32.400s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:24:59.911202 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f8501a57-0be8-4f61-9089-f2844ea89a2b tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-f8f8f60f-b608-455f-b42a-0a02f790e541-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:24:59.914009 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f8501a57-0be8-4f61-9089-f2844ea89a2b tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:25:18.069180 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:25:18.069992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:25:18.102825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:25:18.170393 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:25:31.454351 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f8501a57-0be8-4f61-9089-f2844ea89a2b tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['a3883aec-1afc-4920-9b4b-2cde2d24ebc1', '0741ade7-18a6-4039-9374-7effaaa9948f', '3a3d812d-81d2-4d1b-808b-349d3774007c', 'eef92a29-4975-4ed5-bf1a-b52b7d3bd9f5'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:25:31.832032 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f8501a57-0be8-4f61-9089-f2844ea89a2b tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:25:31.839749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f8501a57-0be8-4f61-9089-f2844ea89a2b tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-f8f8f60f-b608-455f-b42a-0a02f790e541-delete_snapshot'" released by "delete_snapshot" :: held 31.929s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:25:31.939945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-45eba984-b070-4c89-a486-68773c330eee tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-744f854d-acf3-4589-95f5-a3b98d3f0a21-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:25:31.942294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-45eba984-b070-4c89-a486-68773c330eee tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:04.446456 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-45eba984-b070-4c89-a486-68773c330eee tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['c44ca4b4-bab0-49e6-a711-2ef8988ba456', '281b3cdb-7da7-47c9-99f2-b18d56dc1b1f', '00ae316f-255e-47eb-a2fd-4ec6945152b4', '875ca3fb-1937-412d-bf33-d62e9379c589'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:26:04.763145 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-45eba984-b070-4c89-a486-68773c330eee tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:26:04.768986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-45eba984-b070-4c89-a486-68773c330eee tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-744f854d-acf3-4589-95f5-a3b98d3f0a21-delete_snapshot'" released by "delete_snapshot" :: held 32.829s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:26:06.371171 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-05386e19-1210-4bc1-9495-d472e2bea451 req-c6841346-32ad-4bf6-b644-5fad55b701e8 tempest-VolumesSnapshotTestJSON-1404067749 None] Terminate volume connection completed successfully. Nov 13 21:26:06.371853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-05386e19-1210-4bc1-9495-d472e2bea451 req-c6841346-32ad-4bf6-b644-5fad55b701e8 tempest-VolumesSnapshotTestJSON-1404067749 None] Deleting attachment 75f008e2-4c3c-4198-8bec-9de3288a9a48. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:26:12.415447 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-40789e91-132b-448c-92b4-9ee6929368c0 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:17.403176 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-40789e91-132b-448c-92b4-9ee6929368c0 tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:26:17.919262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6ec5f1d7-3b7c-46f0-bd8f-81058b44dda8 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-96deb94c-b94a-42e7-bafc-ae7f3904a816-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.020s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:26:17.934108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ec5f1d7-3b7c-46f0-bd8f-81058b44dda8 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:18.172505 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:26:18.174847 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:18.239666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:18.286894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:26:19.299302 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-0a79596d-6c18-4718-ae41-5293de9f563d tempest-TaggedBootDevicesTest_v242-209704149 None] Terminate volume connection completed successfully. Nov 13 21:26:19.300679 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-0a79596d-6c18-4718-ae41-5293de9f563d tempest-TaggedBootDevicesTest_v242-209704149 None] Deleting attachment 8af20cd5-35de-4e77-b0ff-2339998d4609. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:26:19.597181 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-3d2f48bb-d3cb-4a3b-9667-b7423fa65754 tempest-TaggedBootDevicesTest_v242-209704149 None] Terminate volume connection completed successfully. Nov 13 21:26:19.597601 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-3d2f48bb-d3cb-4a3b-9667-b7423fa65754 tempest-TaggedBootDevicesTest_v242-209704149 None] Deleting attachment c80ee429-e77d-4324-9f14-d00d9cf304ab. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:26:19.930217 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-fb42cf91-b31f-4028-8270-3a8bc51c4c0e tempest-TaggedBootDevicesTest_v242-209704149 None] Terminate volume connection completed successfully. Nov 13 21:26:19.930841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1fc44b92-4dcc-4628-8664-0e2de48fe92c req-fb42cf91-b31f-4028-8270-3a8bc51c4c0e tempest-TaggedBootDevicesTest_v242-209704149 None] Deleting attachment 55439f22-6d20-45c6-ae0f-6e78078f77d5. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:26:23.960176 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-6ec5f1d7-3b7c-46f0-bd8f-81058b44dda8 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['75ca569a-9a57-4d9a-90a1-fd61b7e1c748', 'cd4db0a2-b145-49c7-ad74-fc1688d6a8c8', '03ce7aa2-a83a-4adb-ba69-64dd0b498394', '3e183899-cfaf-479e-bf93-fcbc4039135b'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:26:24.207369 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6ec5f1d7-3b7c-46f0-bd8f-81058b44dda8 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:26:24.213254 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6ec5f1d7-3b7c-46f0-bd8f-81058b44dda8 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-96deb94c-b94a-42e7-bafc-ae7f3904a816-delete_snapshot'" released by "delete_snapshot" :: held 6.294s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:26:24.917106 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ed3f95a-8918-440a-aab6-1c367cbfd02f tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:27.526029 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:26:27.654992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:27.955627 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:26:27.956302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:26:28.301531 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] deleting rbd volume volume-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:26:29.195500 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-5123dafe-2000-4986-86ba-3684db6f9548 tempest-ServersTestBootFromVolume-876085019 None] Terminate volume connection completed successfully. Nov 13 21:26:29.198693 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-5123dafe-2000-4986-86ba-3684db6f9548 tempest-ServersTestBootFromVolume-876085019 None] Deleting attachment f6af944d-0383-4f67-b8b8-76f3e015cb3d. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:26:29.564516 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4ed3f95a-8918-440a-aab6-1c367cbfd02f tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:26:29.670338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] Lock "b'cinder-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:26:29.779538 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:30.179364 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:26:30.455329 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] deleting rbd volume volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:26:36.899904 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Created reservations ['67f07cc4-9ef5-430e-bdcc-4e2bb3accc27', 'ccb19974-c84a-4662-a62e-30f75a28bf21', 'ea168278-f838-4274-afdf-9d6253c945a4', '84946ab0-dde9-4234-95e5-c5fde1d49fa5'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:26:37.182800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:37.252270 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:37.317576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:26:37.324058 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Deleted volume successfully. Nov 13 21:26:37.410660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b85face7-e3ec-47f8-ae58-94987f815a43 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-ae00dcaf-50d7-4b31-8fe3-5de55a83bba9-delete_volume'" released by "delete_volume" :: held 9.885s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:26:37.504250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-90b790f4-4687-48d2-96c5-c007915fee58-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:26:37.628366 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:37.877116 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:26:37.877547 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Volume volume-90b790f4-4687-48d2-96c5-c007915fee58 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:26:38.154277 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] deleting rbd volume volume-90b790f4-4687-48d2-96c5-c007915fee58 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:26:40.737709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:26:41.150882 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] deleting parent snapshot volume-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:26:45.994404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] Created reservations ['5d03811d-fd13-4c20-a71e-1d7687f69e4b', '9f964895-db61-44f1-b25b-72dd20224e61', 'f994af04-42c2-4cfb-8e89-38ab5b4e99bb', 'ac9c8deb-c9f9-4a5e-abc0-0ee57b472fb3'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:26:46.183324 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:46.214522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:46.253231 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:26:46.257790 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] Deleted volume successfully. Nov 13 21:26:46.405172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-abed637b-8197-4f74-8bd2-6d42c9b0dff7 req-1b2bf6f8-2a65-466b-a35d-9bdbec1f703c tempest-ServersTestBootFromVolume-876085019 None] Lock "b'cinder-9d87ed4d-ccbe-414d-839c-e50e18c1e8dc-delete_volume'" released by "delete_volume" :: held 16.734s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:26:47.438820 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Created reservations ['bb910532-007a-4887-8367-8ff1cb3b9e2d', '244f9aa7-e839-4376-8d7b-a8c9213d752c', '9a934b94-ce9e-499a-a1b2-efc24d614e2c', 'c7fddae3-66c9-4403-9dec-438a118cd0df'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:26:47.727912 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:47.880818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:47.957709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:26:47.970688 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Deleted volume successfully. Nov 13 21:26:48.106759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15b08be9-adb3-41ca-a93b-de7ad01892ec tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-90b790f4-4687-48d2-96c5-c007915fee58-delete_volume'" released by "delete_volume" :: held 10.603s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:26:48.397132 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-b7090326-4a71-438f-8d11-ef7a07eb0792 req-c0e306c7-9bcf-4167-a22a-64cd54374537 tempest-VolumesSnapshotTestJSON-1404067749 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:26:48.562380 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-cde6a79d-d391-4d0a-b774-fcaf549a49e6-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:26:48.721392 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:49.012061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:26:49.385889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] deleting rbd volume volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:26:49.814567 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-b7090326-4a71-438f-8d11-ef7a07eb0792 req-c0e306c7-9bcf-4167-a22a-64cd54374537 tempest-VolumesSnapshotTestJSON-1404067749 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.418s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:26:49.816106 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-b7090326-4a71-438f-8d11-ef7a07eb0792 req-c0e306c7-9bcf-4167-a22a-64cd54374537 tempest-VolumesSnapshotTestJSON-1404067749 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:26:49.938819 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-b7090326-4a71-438f-8d11-ef7a07eb0792 req-c0e306c7-9bcf-4167-a22a-64cd54374537 tempest-VolumesSnapshotTestJSON-1404067749 None] Connection info returned from driver {'name': 'volumes/volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c153bc1-b7bd-451c-8f93-eb637acb67b6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8ed49d6d-4137-4600-b091-bb5df389ff1c'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:26:50.069053 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-b7090326-4a71-438f-8d11-ef7a07eb0792 req-c0e306c7-9bcf-4167-a22a-64cd54374537 tempest-VolumesSnapshotTestJSON-1404067749 None] attachment_update completed successfully. Nov 13 21:26:54.409650 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2d2c68ea-d915-4fa0-8c24-214fa7b0c2bf tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:58.050149 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2d2c68ea-d915-4fa0-8c24-214fa7b0c2bf tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:26:58.859600 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-884bcd20-175b-4cdc-95d6-b9e10b5749cc tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:26:59.877313 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:27:00.254111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] deleting parent snapshot volume-cde6a79d-d391-4d0a-b774-fcaf549a49e6.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:27:04.493043 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] Created reservations ['1f1f815b-b9c6-4fe0-92b3-37f653ed4b4f', '3e101fd9-877d-49ba-ad02-0f4745759c9e', '679ac987-50a5-4727-9dad-e4a54334d2f5', '6be983b4-f450-42bd-8dda-adaed6937a86'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:27:04.738189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:04.787076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:04.851994 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:27:04.862381 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] Deleted volume successfully. Nov 13 21:27:04.946351 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a8072445-9ada-4a46-b4d0-3706deef9ec1 tempest-TaggedBootDevicesTest_v242-209704149 None] Lock "b'cinder-cde6a79d-d391-4d0a-b774-fcaf549a49e6-delete_volume'" released by "delete_volume" :: held 16.384s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:27:04.994872 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-884bcd20-175b-4cdc-95d6-b9e10b5749cc tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:27:06.125828 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5d0cd088-e1f9-41f5-aa22-cef0f246b3ca tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-7a993053-d553-4457-b35e-7d728b5a061f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:27:06.127399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5d0cd088-e1f9-41f5-aa22-cef0f246b3ca tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:18.172258 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:27:18.172990 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:18.199565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:18.234897 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:27:37.891094 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-5d0cd088-e1f9-41f5-aa22-cef0f246b3ca tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['60dc9316-c6f3-414a-8cff-499398813488', 'c6d2a424-3fb9-452e-bdba-b57cbf678e1f', '4b9b8b00-ce91-482c-90ad-9f86005c5722', '7baaac8a-b34f-43cd-b03b-1a7a2393bc63'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:27:38.100411 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5d0cd088-e1f9-41f5-aa22-cef0f246b3ca tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:27:38.108665 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5d0cd088-e1f9-41f5-aa22-cef0f246b3ca tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-7a993053-d553-4457-b35e-7d728b5a061f-delete_snapshot'" released by "delete_snapshot" :: held 31.983s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:27:38.382213 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ca85d8bf-49c2-4de7-a7c2-a405d50d4551 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ea039465-a0e0-4039-b2a2-394b706f2e6f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:27:38.384273 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ca85d8bf-49c2-4de7-a7c2-a405d50d4551 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:27:57.438424 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e4b36c39-92ba-41c5-8300-b60388773305 tempest-BackendsCapabilitiesAdminTestsJSON-1321334583 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:fdaf7799-955e-42b6-8e36-a87651fedaa0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 13 21:27:57.473238 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dba34d10-0839-4733-982b-0df43995bb29 tempest-BackendsCapabilitiesAdminTestsJSON-1321334583 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:fdaf7799-955e-42b6-8e36-a87651fedaa0:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=129109) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 13 21:28:03.805147 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-98c2ef70-dba9-4173-8982-93a3bd2d08f6 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-1731822536: creating Nov 13 21:28:03.963914 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-98c2ef70-dba9-4173-8982-93a3bd2d08f6 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-1731822536: created successfully Nov 13 21:28:03.973943 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-98c2ef70-dba9-4173-8982-93a3bd2d08f6 tempest-GroupSnapshotsTest-1830456192 None] Create group completed successfully. Nov 13 21:28:05.843838 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:28:05.849123 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:28:05.849605 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:28:05.863314 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (93148f6e-fb0d-4741-902d-b3432b8ad389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:05.868042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807cc9cc-601a-4ea6-9111-acaed9d02157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:05.876500 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:28:05.894777 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (807cc9cc-601a-4ea6-9111-acaed9d02157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:28:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1085631844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9348aaf9-2263-4942-823f-e96fc5eb053b,host='ncdv-master-1@ceph#ceph',id=b345ed28-3d85-4041-98c9-cfd3238aab82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab37755386457aa2bb0a81b3446bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:28:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:28:06Z,use_quota=True,user_id='ae7dc96540804289bc1e01842ccf5e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca0ad46d-141c-4fe6-b5b8-545a921d1866),volume_type_id=ca0ad46d-141c-4fe6-b5b8-545a921d1866)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:05.898011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60948d7-06be-403a-ab52-69e0cd8728f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:05.900945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60948d7-06be-403a-ab52-69e0cd8728f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:05.903856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d237055-cde5-4f2a-b4c8-287e63181639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:05.906558 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d237055-cde5-4f2a-b4c8-287e63181639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b345ed28-3d85-4041-98c9-cfd3238aab82', 'volume_name': 'volume-b345ed28-3d85-4041-98c9-cfd3238aab82', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:05.909327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c567558c-2675-4b97-9b1c-ce716493c294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:05.913757 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c567558c-2675-4b97-9b1c-ce716493c294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:05.916904 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a736ed-6b30-4aec-9aa0-341522a658b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:05.937599 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Volume b345ed28-3d85-4041-98c9-cfd3238aab82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b345ed28-3d85-4041-98c9-cfd3238aab82', 'volume_size': 1} Nov 13 21:28:05.938110 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] creating volume 'volume-b345ed28-3d85-4041-98c9-cfd3238aab82' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:28:05.939212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:07.982305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:28:07.983785 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:28:07.986247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a736ed-6b30-4aec-9aa0-341522a658b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b345ed28-3d85-4041-98c9-cfd3238aab82', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:07.991682 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5652fa6-2562-48eb-926e-ac52c25e2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:08.067882 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Volume volume-b345ed28-3d85-4041-98c9-cfd3238aab82 (b345ed28-3d85-4041-98c9-cfd3238aab82): created successfully Nov 13 21:28:08.070680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5652fa6-2562-48eb-926e-ac52c25e2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:08.074822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (93148f6e-fb0d-4741-902d-b3432b8ad389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:08.199321 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-18d09919-6d71-4dbf-8b16-aee72ade9b92 tempest-GroupSnapshotsTest-1830456192 None] Created volume successfully. Nov 13 21:28:09.556218 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e841beec-d0ce-415d-8b35-70eac483dcf4 tempest-GroupSnapshotsTest-1830456192 None] GroupSnapshot 4422bceb-5124-4986-80f0-34471c5abbbb: creating. Nov 13 21:28:09.586545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e841beec-d0ce-415d-8b35-70eac483dcf4 tempest-GroupSnapshotsTest-1830456192 None] Group snapshot 4422bceb-5124-4986-80f0-34471c5abbbb: creating. {{(pid=129109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 13 21:28:09.606291 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e841beec-d0ce-415d-8b35-70eac483dcf4 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:10.598873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ca85d8bf-49c2-4de7-a7c2-a405d50d4551 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['146c0a84-750b-4876-aa68-4719ce90ff7f', 'e8316473-ce35-44e1-9e71-4f970d9d7e17', '5d78a1a0-d54d-4b39-ad90-acb13644061a', 'f1fb4a3d-5b71-497b-a915-4f7e2f5b0680'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:10.826135 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ca85d8bf-49c2-4de7-a7c2-a405d50d4551 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:28:10.851197 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ca85d8bf-49c2-4de7-a7c2-a405d50d4551 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ea039465-a0e0-4039-b2a2-394b706f2e6f-delete_snapshot'" released by "delete_snapshot" :: held 32.469s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:28:11.614303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2b0a20c8-55ee-452c-9bdc-8d88e4386535 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-f28924af-6545-43cc-b55f-4b9d2004e7e2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.017s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:28:11.617355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2b0a20c8-55ee-452c-9bdc-8d88e4386535 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:14.893389 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e841beec-d0ce-415d-8b35-70eac483dcf4 tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 4422bceb-5124-4986-80f0-34471c5abbbb: created successfully Nov 13 21:28:17.057512 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] cloning volumes/volume-b345ed28-3d85-4041-98c9-cfd3238aab82@snapshot-86c3f4ad-34a9-4c68-915e-b608367bc6e7 to volume-77981f55-c10c-4407-a107-bc2b5ae45b15 {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:28:17.058757 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:17.107368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:18.176191 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:28:18.177697 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:18.203362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:18.236198 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:28:19.660645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:28:19.661853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:28:20.111092 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-337233f8-4c31-4d5b-93b4-7e300c562da9 tempest-GroupSnapshotsTest-1830456192 None] Create group from source-snapshot-4422bceb-5124-4986-80f0-34471c5abbbb completed successfully. Nov 13 21:28:20.899838 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:21.146569 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:28:21.323084 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] deleting rbd volume volume-77981f55-c10c-4407-a107-bc2b5ae45b15 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:28:29.641583 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['1bde939f-8368-4cca-97c4-e9783e62b007'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:29.657375 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1970155334 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1970155334, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:28:29.658163 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1970155334 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1970155334, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:28:29.755988 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['f89b00d2-6ccd-47c3-b675-3d5756c06a8b', '6a61b55d-3a9c-48f2-a82f-140b429d8a77', '4e129f1a-24c2-45ce-a746-da479edd3e7a', '7a6758d0-29f5-4c3c-ae52-7c9ba89bfcce'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:30.201574 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:30.236233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:30.266038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:28:30.270281 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e296ff4d-424c-4645-9503-2f3beeae89bd tempest-GroupSnapshotsTest-1830456192 None] Delete group completed successfully. Nov 13 21:28:30.843368 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 4422bceb-5124-4986-80f0-34471c5abbbb: deleting Nov 13 21:28:30.896634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 4422bceb-5124-4986-80f0-34471c5abbbb: deleting {{(pid=129109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 13 21:28:30.935563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:35.141329 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1970155334 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1970155334, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:28:35.226957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['6b0e4282-8fed-4995-b971-a64c962c2e76', '17f2c8a1-8081-4bdf-9de7-929b5de20b94', '5b9a67ea-bfcb-4470-8dec-3ce75f90658b', '37be595c-6e2a-40a2-aae3-0ec1c0d413e5'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:35.612409 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e6f076df-47d8-4f74-be86-62aad570cd7e tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 4422bceb-5124-4986-80f0-34471c5abbbb: deleted successfully Nov 13 21:28:36.547242 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:36.912486 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:28:36.912969 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Volume volume-b345ed28-3d85-4041-98c9-cfd3238aab82 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:28:37.155671 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] deleting rbd volume volume-b345ed28-3d85-4041-98c9-cfd3238aab82 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:28:44.072511 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2b0a20c8-55ee-452c-9bdc-8d88e4386535 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['eb3f586f-caeb-4067-bbc0-300585babc3b', '32381879-e26b-4f9e-b42f-8cd5b34e26d8', 'a08385c2-2fb0-453f-94af-b3ed8368e90f', 'e892bb42-20e9-471f-803a-10d1abb3d2d1'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:44.349467 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2b0a20c8-55ee-452c-9bdc-8d88e4386535 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:28:44.355303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2b0a20c8-55ee-452c-9bdc-8d88e4386535 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-f28924af-6545-43cc-b55f-4b9d2004e7e2-delete_snapshot'" released by "delete_snapshot" :: held 32.741s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:28:44.910687 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['c52311c9-3651-4224-8eb5-a74cce4c8015'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:44.944348 ncdv-master-1 cinder-volume[129109]: WARNING cinder.db.sqlalchemy.api [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1970155334'] Nov 13 21:28:45.009980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['3418c512-2c28-4b5b-a3d6-2237052fb8b7', '7bdf4649-c4b8-4a73-babf-91ae5d644ddc', '941e7a02-806b-4f0f-8ce0-4bba40f4e60a', 'ac640c31-9319-429c-b953-ff2dca28735f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:28:45.416504 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:45.440057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:45.463174 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:28:45.467368 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-360bb3eb-3d7b-4234-91e7-b9d8c4515ecc tempest-GroupSnapshotsTest-1830456192 None] Delete group completed successfully. Nov 13 21:28:45.728810 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-78ac3385-477b-4b57-9846-729ef327042b req-9f0124b6-5625-4b28-a9d4-c43e4b8e6d2f tempest-VolumesSnapshotTestJSON-1404067749 None] Terminate volume connection completed successfully. Nov 13 21:28:45.729217 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-78ac3385-477b-4b57-9846-729ef327042b req-9f0124b6-5625-4b28-a9d4-c43e4b8e6d2f tempest-VolumesSnapshotTestJSON-1404067749 None] Deleting attachment 8ed49d6d-4137-4600-b091-bb5df389ff1c. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:28:46.966222 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3cab5400-4b35-4b0d-8cd5-e80ea5964098 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-2096926095: creating Nov 13 21:28:47.050233 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3cab5400-4b35-4b0d-8cd5-e80ea5964098 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-2096926095: created successfully Nov 13 21:28:47.060395 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3cab5400-4b35-4b0d-8cd5-e80ea5964098 tempest-GroupSnapshotsTest-1830456192 None] Create group completed successfully. Nov 13 21:28:49.031460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:28:49.034714 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:28:49.035238 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:28:49.047919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (ec60fdf9-6b58-4405-8fee-7eabe4115a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:49.051065 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6a7da-e077-4f02-865d-490dac44173d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:49.057850 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:28:49.070761 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc6a7da-e077-4f02-865d-490dac44173d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-231380466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602fe16b-00db-4b9b-9ebd-fb067ca6370a,host='ncdv-master-1@ceph#ceph',id=4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab37755386457aa2bb0a81b3446bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:28:49Z,use_quota=True,user_id='ae7dc96540804289bc1e01842ccf5e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7152d6-4d47-4c54-b632-e6aa638967ac),volume_type_id=7b7152d6-4d47-4c54-b632-e6aa638967ac)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:49.073393 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800f0b39-4bf1-48b7-8679-4a47e0eb4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:49.075485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (800f0b39-4bf1-48b7-8679-4a47e0eb4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:49.077801 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36453c0-63da-4627-88af-4c63d78fc653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:49.080016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36453c0-63da-4627-88af-4c63d78fc653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2', 'volume_name': 'volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:49.082231 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f89d1d-9c1e-4947-9c4e-c6b5a60c3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:49.084226 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f89d1d-9c1e-4947-9c4e-c6b5a60c3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:49.086541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b46d9-c196-4b18-b2bb-e9514d082dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:49.105418 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Volume 4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2', 'volume_size': 1} Nov 13 21:28:49.105885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] creating volume 'volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:28:49.107023 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:50.329015 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:28:50.329015 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:28:50.329667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (591b46d9-c196-4b18-b2bb-e9514d082dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:50.331468 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e74bb7-6308-4a8c-9cf5-b43644d96c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:50.472555 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Volume volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2 (4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2): created successfully Nov 13 21:28:50.474662 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87e74bb7-6308-4a8c-9cf5-b43644d96c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:50.477761 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (ec60fdf9-6b58-4405-8fee-7eabe4115a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:50.629546 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-16ca9619-2c04-4d44-a006-729695c93fcf tempest-GroupSnapshotsTest-1830456192 None] Created volume successfully. Nov 13 21:28:51.067721 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:28:51.071065 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:28:51.071575 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:28:51.084140 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (e2cf464d-7312-41b6-b0f1-a21f25c59e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:51.090555 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4e1d46-4fc6-4a20-9e1f-86bf48544a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.093732 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:28:51.105949 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f4e1d46-4fc6-4a20-9e1f-86bf48544a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230098657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=899d57c9-164d-4b4e-b6ec-3e5bec81118c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:28:51Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.108424 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc37dc1b-ac86-4d49-96ea-0f87f61bd651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.110519 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc37dc1b-ac86-4d49-96ea-0f87f61bd651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.112806 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f426bff-4035-410d-8793-3e37457ce08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.115297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f426bff-4035-410d-8793-3e37457ce08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '899d57c9-164d-4b4e-b6ec-3e5bec81118c', 'volume_name': 'volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.119321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1084f2a5-b1fe-44fb-b5f0-055c08d6207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.119476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1084f2a5-b1fe-44fb-b5f0-055c08d6207d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.122428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b31b16-3af9-459c-8eca-d5b131be9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.123191 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume 899d57c9-164d-4b4e-b6ec-3e5bec81118c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c', 'volume_size': 1} Nov 13 21:28:51.123587 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] creating volume 'volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:28:51.124567 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:51.859102 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:28:51.862909 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:28:51.863723 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:28:51.878938 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (c5ecd3e5-d514-4b67-9784-ed14562d5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:51.883235 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7fff03-5121-468a-9fe8-a16754027b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.891495 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:28:51.906881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d7fff03-5121-468a-9fe8-a16754027b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1664540129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=602fe16b-00db-4b9b-9ebd-fb067ca6370a,host='ncdv-master-1@ceph#ceph',id=d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab37755386457aa2bb0a81b3446bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:28:52Z,use_quota=True,user_id='ae7dc96540804289bc1e01842ccf5e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7152d6-4d47-4c54-b632-e6aa638967ac),volume_type_id=7b7152d6-4d47-4c54-b632-e6aa638967ac)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.909839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aef42ca-3b33-4d00-b423-f1fb3778c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.912966 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aef42ca-3b33-4d00-b423-f1fb3778c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.915635 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6094a9-11ce-4ae6-b4d0-8665700fd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.918866 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6094a9-11ce-4ae6-b4d0-8665700fd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c4d0fb-2d4e-429a-9cc0-92a336ad2fed', 'volume_name': 'volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.921369 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481eede0-b06a-4ae7-ab93-62b941c1005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.924607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481eede0-b06a-4ae7-ab93-62b941c1005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:51.927564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6bd2a-1714-462b-b315-ba89cad0c47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:51.957069 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Volume d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed', 'volume_size': 1} Nov 13 21:28:51.957615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] creating volume 'volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:28:51.958644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:52.299535 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:28:52.300428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:28:52.302672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b31b16-3af9-459c-8eca-d5b131be9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:52.306805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06b79a0-7755-4abb-a125-e8587be0016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:52.490484 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c (899d57c9-164d-4b4e-b6ec-3e5bec81118c): created successfully Nov 13 21:28:52.490484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06b79a0-7755-4abb-a125-e8587be0016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:52.494467 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (e2cf464d-7312-41b6-b0f1-a21f25c59e35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:52.594732 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-c5281a0a-c948-46d0-aa72-7118da618dc0 tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:28:53.356312 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:28:53.357353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:28:53.362037 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e6bd2a-1714-462b-b315-ba89cad0c47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:53.364270 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeff348c-7135-4efc-b53c-90952c7723af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:53.458190 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Volume volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed (d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed): created successfully Nov 13 21:28:53.463195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeff348c-7135-4efc-b53c-90952c7723af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:53.484265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (c5ecd3e5-d514-4b67-9784-ed14562d5b84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:53.575708 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-dda15f44-9960-4198-b78c-a80088322a5a tempest-GroupSnapshotsTest-1830456192 None] Created volume successfully. Nov 13 21:28:53.667755 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9382bebc-2b61-4530-aae8-999a3ad6a068 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:54.287990 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4a9f179c-92c8-440e-927f-6b6cb4a218b0 tempest-GroupSnapshotsTest-1830456192 None] Update group completed successfully. Nov 13 21:28:55.571644 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4c3ae6be-8a96-4180-9274-f6404c1a224d tempest-GroupSnapshotsTest-1830456192 None] Update group completed successfully. Nov 13 21:28:56.995861 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b0692712-abd1-4d85-adce-7317f4856a88 tempest-GroupSnapshotsTest-1830456192 None] Update group completed successfully. Nov 13 21:28:57.369381 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9382bebc-2b61-4530-aae8-999a3ad6a068 tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:28:58.220012 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-767e6e21-678b-4528-997a-ed81a58d05c4 tempest-GroupSnapshotsTest-1830456192 None] Update group completed successfully. Nov 13 21:28:58.552145 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:28:58.560257 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:28:58.561314 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:28:58.644744 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (4b9d5acf-d3a7-45d9-bc8f-1e98d7a4f736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:28:58.652708 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aedaf8-7da6-42d7-9014-2bb2a5ee6832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:58.668208 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:28:58.681955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8aedaf8-7da6-42d7-9014-2bb2a5ee6832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-448664362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab4b9332-cbc6-48ca-96a1-4aeed4743b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:28:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=10a1d898-0fa3-49a5-b06c-e58d2a1bd723,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:28:58Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:58.685152 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a87a0c-b331-48df-b5ca-bbd3ee4d6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:58.687583 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a87a0c-b331-48df-b5ca-bbd3ee4d6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:58.690321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b592d94c-299b-429e-8279-a4e3a014c531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:58.693569 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b592d94c-299b-429e-8279-a4e3a014c531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ab4b9332-cbc6-48ca-96a1-4aeed4743b49', 'volume_name': 'volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49', 'volume_size': 2, 'snapshot_id': '10a1d898-0fa3-49a5-b06c-e58d2a1bd723'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:58.709013 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12782884-1818-42ff-b7c5-c18cb0511193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:58.712529 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12782884-1818-42ff-b7c5-c18cb0511193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:28:58.717779 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c9eab9-18a1-468f-8938-39d64ef5f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:28:58.718797 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Volume ab4b9332-cbc6-48ca-96a1-4aeed4743b49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49', 'volume_size': 2, 'snapshot_id': '10a1d898-0fa3-49a5-b06c-e58d2a1bd723'} Nov 13 21:28:58.746462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] cloning volumes/volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c@snapshot-10a1d898-0fa3-49a5-b06c-e58d2a1bd723 to volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49 {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:28:58.747795 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:28:58.857416 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:00.707433 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-25c7d9c7-b9f5-4000-8cb7-9c2114e839bc tempest-GroupSnapshotsTest-1830456192 None] GroupSnapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: creating. Nov 13 21:29:00.756227 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25c7d9c7-b9f5-4000-8cb7-9c2114e839bc tempest-GroupSnapshotsTest-1830456192 None] Group snapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: creating. {{(pid=129109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 13 21:29:00.813873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25c7d9c7-b9f5-4000-8cb7-9c2114e839bc tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:01.586474 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:29:01.587006 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:29:01.593257 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:04.235760 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c9eab9-18a1-468f-8938-39d64ef5f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49', 'volume_size': 2, 'snapshot_id': '10a1d898-0fa3-49a5-b06c-e58d2a1bd723'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:04.238595 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f44444-f5a5-430a-abb5-0cf4f88b49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:04.421008 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49 (ab4b9332-cbc6-48ca-96a1-4aeed4743b49): created successfully Nov 13 21:29:04.426390 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f44444-f5a5-430a-abb5-0cf4f88b49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:04.430869 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (4b9d5acf-d3a7-45d9-bc8f-1e98d7a4f736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:04.540478 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3d525d43-26c1-4a36-9fcc-bd96b21ad5be tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:29:05.097891 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25c7d9c7-b9f5-4000-8cb7-9c2114e839bc tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:05.482373 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ab4b9332-cbc6-48ca-96a1-4aeed4743b49-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:29:05.648500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:06.054331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:06.333298 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-ab4b9332-cbc6-48ca-96a1-4aeed4743b49 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:10.321971 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-25c7d9c7-b9f5-4000-8cb7-9c2114e839bc tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: created successfully Nov 13 21:29:10.668253 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: deleting Nov 13 21:29:10.708420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: deleting {{(pid=129109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 13 21:29:10.729142 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:15.367618 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:15.726176 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['01cdf77e-a7d4-4b73-8444-fecd01c1f68b', 'ae6f5326-a815-4da9-89e3-9f0672a32fe0', '2f57d631-8fb0-4617-b7fd-c5dfe6a105d0', '582975c0-cf25-475c-87fb-0e4b2555ae72'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:16.074747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:16.249155 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:16.347680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:16.358915 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:29:16.492493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-095320df-f927-4d2d-af4a-360861a6bb25 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-ab4b9332-cbc6-48ca-96a1-4aeed4743b49-delete_volume'" released by "delete_volume" :: held 11.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:29:16.976199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:29:16.980004 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:29:16.980451 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:29:16.992971 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (6d2ef2aa-9b34-4c83-80c1-3bcd55268916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:16.996536 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6c3746-90e5-4801-851f-03a8932e7ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:17.006714 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:29:17.024524 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc6c3746-90e5-4801-851f-03a8932e7ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1360964332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fb81807a-b86f-4d49-a57d-cd6913670959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:29:17Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:17.027362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2c5baa-976e-4e36-9542-e975a5a7c818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:17.029718 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e2c5baa-976e-4e36-9542-e975a5a7c818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:17.032417 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1912729a-d4ae-49ea-b57b-4fcf1166ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:17.034587 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1912729a-d4ae-49ea-b57b-4fcf1166ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb81807a-b86f-4d49-a57d-cd6913670959', 'volume_name': 'volume-fb81807a-b86f-4d49-a57d-cd6913670959', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:17.036822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecfc888-cef1-4fa1-ab2f-b56ed516cf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:17.038833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ecfc888-cef1-4fa1-ab2f-b56ed516cf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:17.041012 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afddf675-94c3-4beb-a697-cee244dec033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:17.041765 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Volume fb81807a-b86f-4d49-a57d-cd6913670959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb81807a-b86f-4d49-a57d-cd6913670959', 'volume_size': 1} Nov 13 21:29:17.042148 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] creating volume 'volume-fb81807a-b86f-4d49-a57d-cd6913670959' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:29:17.043108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:18.132522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:29:18.133287 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:29:18.135132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afddf675-94c3-4beb-a697-cee244dec033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb81807a-b86f-4d49-a57d-cd6913670959', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:18.143064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c679091-6fde-4353-ae43-a1607a07452e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:18.173796 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:29:18.174656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:18.229269 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:18.282537 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:18.286792 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-fb81807a-b86f-4d49-a57d-cd6913670959 (fb81807a-b86f-4d49-a57d-cd6913670959): created successfully Nov 13 21:29:18.289747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c679091-6fde-4353-ae43-a1607a07452e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:18.295152 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (6d2ef2aa-9b34-4c83-80c1-3bcd55268916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:18.439506 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5699c63c-69ee-4381-ab08-5ecfaf03feca tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:29:19.621934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd6a6d3d-3752-4b8f-bd24-85b2c2c4434e tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:20.783266 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1195309408 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1195309408, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:29:20.784065 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1195309408 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1195309408, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:29:20.868276 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['6b6635a8-f901-42bb-b3a2-c8ca48fe3e36', '0c966913-2f50-4509-a123-81c4f392535b', '697798e7-6d1c-4b9d-8cbf-70b037ffb3c1', '036c6308-cfaf-4fde-8902-7b99a550bbc8'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:21.166250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['aa74c125-eba2-4840-894d-0e855351194d', '7f9c75b1-9da6-49be-807f-c3e40cc8c759', 'ddb19fed-6f1f-4202-8733-4bf1d3c462ad', 'e708aeae-31f1-4f79-9995-6c185672776f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:21.411329 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fbca8fd8-4191-4b59-b240-a804402c43c7 tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6fe3c71b-26fc-40f0-93fd-a64261eb43f7: deleted successfully Nov 13 21:29:22.768365 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:23.171130 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:23.171558 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Volume volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:29:23.408857 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] deleting rbd volume volume-4b5ba6e4-d1b5-4647-8cda-8b0eda0960d2 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:24.731102 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fd6a6d3d-3752-4b8f-bd24-85b2c2c4434e tempest-VolumesSnapshotTestJSON-1404067749 None] Create snapshot completed successfully Nov 13 21:29:26.770229 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:29:26.773914 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:29:26.780906 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:29:26.814488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (19a0a812-68a4-45ff-a513-caeb3ee0d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:26.823337 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2fcfc7-f1d8-4be5-b923-54c44388923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:26.836897 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:29:26.854330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2fcfc7-f1d8-4be5-b923-54c44388923e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1156914963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=12e01e19-adc4-4c5e-a735-c993f237fb13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87ef4a1c09f3441596d38ab535257613',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bd2f7c3-a977-462c-8e62-3bd93cac7d54,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:29:26Z,use_quota=True,user_id='220619a3d0ee47e093ddb3f8ed93bc91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:26.865033 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d18ce6-bbf8-4827-8845-ffe99ca28d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:26.885916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d18ce6-bbf8-4827-8845-ffe99ca28d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:26.885916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348c342a-3f14-4e35-b623-bcc4afb65f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:26.885916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (348c342a-3f14-4e35-b623-bcc4afb65f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12e01e19-adc4-4c5e-a735-c993f237fb13', 'volume_name': 'volume-12e01e19-adc4-4c5e-a735-c993f237fb13', 'volume_size': 1, 'snapshot_id': '5bd2f7c3-a977-462c-8e62-3bd93cac7d54'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:26.886508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df427b25-d5b1-433a-9c3c-1525764689f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:26.886508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df427b25-d5b1-433a-9c3c-1525764689f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:26.886508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16ef869-0696-4638-8b9d-fd5d5694fb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:26.886508 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Volume 12e01e19-adc4-4c5e-a735-c993f237fb13: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12e01e19-adc4-4c5e-a735-c993f237fb13', 'volume_size': 1, 'snapshot_id': '5bd2f7c3-a977-462c-8e62-3bd93cac7d54'} Nov 13 21:29:26.904798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] cloning volumes/volume-fb81807a-b86f-4d49-a57d-cd6913670959@snapshot-5bd2f7c3-a977-462c-8e62-3bd93cac7d54 to volume-12e01e19-adc4-4c5e-a735-c993f237fb13 {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:29:26.910899 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:26.958535 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:29.592234 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:29:29.593774 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:29:29.612085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16ef869-0696-4638-8b9d-fd5d5694fb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12e01e19-adc4-4c5e-a735-c993f237fb13', 'volume_size': 1, 'snapshot_id': '5bd2f7c3-a977-462c-8e62-3bd93cac7d54'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:29.614462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2055dc46-3c7c-4280-83bb-02408e62e472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:29.785591 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-12e01e19-adc4-4c5e-a735-c993f237fb13 (12e01e19-adc4-4c5e-a735-c993f237fb13): created successfully Nov 13 21:29:29.787733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2055dc46-3c7c-4280-83bb-02408e62e472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:29.791309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Flow 'volume_create_manager' (19a0a812-68a4-45ff-a513-caeb3ee0d934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:29.909899 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-52aa38e2-bf4a-4379-9c09-065a2d038a9d tempest-VolumesSnapshotTestJSON-1404067749 None] Created volume successfully. Nov 13 21:29:30.962090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-12e01e19-adc4-4c5e-a735-c993f237fb13-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:29:31.124229 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:31.394571 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:31.769073 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-12e01e19-adc4-4c5e-a735-c993f237fb13 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:32.120853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:32.419120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:32.419477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Volume volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:29:32.720554 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] deleting rbd volume volume-d3c4d0fb-2d4e-429a-9cc0-92a336ad2fed {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:41.782443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['f6a3aa7d-cc20-41cf-8619-e2afbd7c2a52', '4660630c-fc0b-4efc-922b-152af1858c70', 'b8e55bd1-7b5b-4340-a144-40c4ac2cb13d', '74125ee8-3a78-4681-9144-29f0c2f63975'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:41.968905 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['c5a2aa1c-4dea-4c92-81e4-6b6f082fab0d'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:41.989085 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1195309408 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1195309408, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:29:42.044611 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:42.096243 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:42.149401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:42.155524 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:29:42.262233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['a6530048-fa20-4771-9005-d19973e7f88d', '6a0f2b41-7742-403e-a568-e5c530b5cc5a', '8299c067-32b3-450d-b46c-6f6d3ad39666', '0796fe69-a5a8-4512-b75a-6ea0bb57a03a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:42.328394 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1038ea01-119a-437a-a054-336325a68823 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-12e01e19-adc4-4c5e-a735-c993f237fb13-delete_volume'" released by "delete_volume" :: held 11.366s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:29:42.799323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b9d4a70d-1391-48b0-b8fc-8d5f04aed288 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-5bd2f7c3-a977-462c-8e62-3bd93cac7d54-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.031s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:29:42.799323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b9d4a70d-1391-48b0-b8fc-8d5f04aed288 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:43.103405 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1dbda950-1519-4882-b34f-8b882e87ccb5 tempest-GroupsTest-1641933210 None] Group tempest-Group1-2035608167: creating Nov 13 21:29:43.150865 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['f3de6594-4824-4f52-9c4f-3de44d5ab2f1', 'c9f21d80-d353-4bc6-acd1-5be89274ea0d', 'f7954423-f73a-4f69-8ce9-5915a3017820', 'd33003ee-7426-4348-9464-ba80d36fc99e'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:43.206640 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1dbda950-1519-4882-b34f-8b882e87ccb5 tempest-GroupsTest-1641933210 None] Group tempest-Group1-2035608167: created successfully Nov 13 21:29:43.216410 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1dbda950-1519-4882-b34f-8b882e87ccb5 tempest-GroupsTest-1641933210 None] Create group completed successfully. Nov 13 21:29:43.565631 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:43.598128 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:43.622917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:43.627215 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a5addb4a-8912-4f06-9b37-f13989476327 tempest-GroupSnapshotsTest-1830456192 None] Delete group completed successfully. Nov 13 21:29:44.444031 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-dec4d723-1025-47b4-a3df-9e16c6a5a2aa tempest-GroupsTest-1641933210 None] Group tempest-Group2-327672322: creating Nov 13 21:29:44.742296 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-dec4d723-1025-47b4-a3df-9e16c6a5a2aa tempest-GroupsTest-1641933210 None] Group tempest-Group2-327672322: created successfully Nov 13 21:29:44.751857 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-dec4d723-1025-47b4-a3df-9e16c6a5a2aa tempest-GroupsTest-1641933210 None] Create group completed successfully. Nov 13 21:29:45.583542 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-456ffd03-ff72-4903-a31c-da74236c8c19 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-946087750: creating Nov 13 21:29:45.775185 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-456ffd03-ff72-4903-a31c-da74236c8c19 tempest-GroupSnapshotsTest-1830456192 None] Group tempest-GroupSnapshotsTest-Group-946087750: created successfully Nov 13 21:29:45.785994 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-456ffd03-ff72-4903-a31c-da74236c8c19 tempest-GroupSnapshotsTest-1830456192 None] Create group completed successfully. Nov 13 21:29:46.572333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:29:46.582269 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:29:46.582719 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:29:46.595490 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (09d652fa-efb3-40cf-9278-edf081f1721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:46.598565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63d72d7-08af-469c-a60b-bfc31cd55927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:46.604939 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:29:46.617968 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63d72d7-08af-469c-a60b-bfc31cd55927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-212556407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ee6c8ad7-2db4-4d14-a20c-84e93ab2c24e,host='ncdv-master-1@ceph#ceph',id=1d365d7d-0654-4a90-ad08-755371ed6721,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f051abab4b4ab9b1ef81698e085b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:29:46Z,use_quota=True,user_id='6b7188792f15471785dac083ed6fcfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7be618d8-1ac4-4423-abb9-ff297354d0de),volume_type_id=7be618d8-1ac4-4423-abb9-ff297354d0de)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:46.620718 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1436a4f-6db2-4f28-9fba-49f97855adbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:46.622776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1436a4f-6db2-4f28-9fba-49f97855adbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:46.625089 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af8fb55-5d3f-47ce-96ea-dd8e0679b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:46.627225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af8fb55-5d3f-47ce-96ea-dd8e0679b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d365d7d-0654-4a90-ad08-755371ed6721', 'volume_name': 'volume-1d365d7d-0654-4a90-ad08-755371ed6721', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:46.629445 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f223cb-4e49-4fc1-aa81-dd91806a38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:46.631452 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f223cb-4e49-4fc1-aa81-dd91806a38db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:46.634331 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6daa7-6623-4837-b4c4-d0876628f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:46.649035 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Volume 1d365d7d-0654-4a90-ad08-755371ed6721: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d365d7d-0654-4a90-ad08-755371ed6721', 'volume_size': 1} Nov 13 21:29:46.649321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] creating volume 'volume-1d365d7d-0654-4a90-ad08-755371ed6721' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:29:46.650524 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:47.239063 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-b9d4a70d-1391-48b0-b8fc-8d5f04aed288 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['24b1d5fe-894e-43d5-813c-f2e5a7e5d509', 'e759ca53-42e2-4438-a99e-e16968fe8e62', '0b265208-d654-416b-a2ea-dd875ef3db21', 'b5570d39-bbf3-4c2f-ada7-f811d12dd9ad'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:47.510817 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b9d4a70d-1391-48b0-b8fc-8d5f04aed288 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:29:47.518825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b9d4a70d-1391-48b0-b8fc-8d5f04aed288 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-5bd2f7c3-a977-462c-8e62-3bd93cac7d54-delete_snapshot'" released by "delete_snapshot" :: held 4.722s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:29:47.709862 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:29:47.714301 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:29:47.714790 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:29:47.729503 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (680a5a94-f424-4502-9fbc-c13e1497d4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:47.733007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827492e1-3f7e-4042-9d1d-c9214ebec008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:47.740788 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:29:47.753701 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827492e1-3f7e-4042-9d1d-c9214ebec008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1970500529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63015c6b-247d-478f-97d1-36517049a3f3,host='ncdv-master-1@ceph#ceph',id=533bac28-a8c5-43bb-a560-5357a6282588,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='caab37755386457aa2bb0a81b3446bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:29:48Z,use_quota=True,user_id='ae7dc96540804289bc1e01842ccf5e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd8c251a-0900-4d76-8f66-438561b26c47),volume_type_id=fd8c251a-0900-4d76-8f66-438561b26c47)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:47.756259 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee20fdfc-1a74-4ffb-9cca-7bb88c6baf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:47.758948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee20fdfc-1a74-4ffb-9cca-7bb88c6baf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:47.761293 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18514ee-739d-41df-9476-92d1805978fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:47.763532 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18514ee-739d-41df-9476-92d1805978fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533bac28-a8c5-43bb-a560-5357a6282588', 'volume_name': 'volume-533bac28-a8c5-43bb-a560-5357a6282588', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:47.781212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a56d3e2-270b-4caf-8a2b-66ebbd29d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:47.783498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a56d3e2-270b-4caf-8a2b-66ebbd29d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:47.785827 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbbf29b-64b4-4fc1-b70d-ece2cdefbe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:47.802887 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Volume 533bac28-a8c5-43bb-a560-5357a6282588: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533bac28-a8c5-43bb-a560-5357a6282588', 'volume_size': 1} Nov 13 21:29:47.803315 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] creating volume 'volume-533bac28-a8c5-43bb-a560-5357a6282588' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:29:47.804345 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:48.011147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:29:48.011545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:29:48.013733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f6daa7-6623-4837-b4c4-d0876628f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d365d7d-0654-4a90-ad08-755371ed6721', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:48.015980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d74983-de2b-4fb8-93b6-d12dd6c0330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:48.147707 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Volume volume-1d365d7d-0654-4a90-ad08-755371ed6721 (1d365d7d-0654-4a90-ad08-755371ed6721): created successfully Nov 13 21:29:48.149752 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11d74983-de2b-4fb8-93b6-d12dd6c0330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:48.153299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (09d652fa-efb3-40cf-9278-edf081f1721f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:48.207710 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-fb81807a-b86f-4d49-a57d-cd6913670959-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:29:48.238394 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4a095302-2bcb-4cf0-87db-db3db97ee391 tempest-GroupsTest-1641933210 None] Created volume successfully. Nov 13 21:29:48.310790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:48.661635 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:48.662300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-fb81807a-b86f-4d49-a57d-cd6913670959 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:29:48.968559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-fb81807a-b86f-4d49-a57d-cd6913670959 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:48.976566 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:29:48.977274 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:29:48.980030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbbf29b-64b4-4fc1-b70d-ece2cdefbe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533bac28-a8c5-43bb-a560-5357a6282588', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:48.983925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a231147c-24dc-482b-b564-4e117ae70a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:29:49.105154 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Volume volume-533bac28-a8c5-43bb-a560-5357a6282588 (533bac28-a8c5-43bb-a560-5357a6282588): created successfully Nov 13 21:29:49.107054 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a231147c-24dc-482b-b564-4e117ae70a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:29:49.110463 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Flow 'volume_create_manager' (680a5a94-f424-4502-9fbc-c13e1497d4e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:29:49.197255 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-284ea1df-755a-4d33-aa63-281686384fbb tempest-GroupSnapshotsTest-1830456192 None] Created volume successfully. Nov 13 21:29:49.207767 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:49.508287 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:29:49.508880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Volume volume-1d365d7d-0654-4a90-ad08-755371ed6721 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:29:49.908604 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] deleting rbd volume volume-1d365d7d-0654-4a90-ad08-755371ed6721 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:29:50.235535 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-20caa128-0828-4b8d-a34c-a6e586056a57 tempest-GroupSnapshotsTest-1830456192 None] GroupSnapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: creating. Nov 13 21:29:50.252400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-20caa128-0828-4b8d-a34c-a6e586056a57 tempest-GroupSnapshotsTest-1830456192 None] Group snapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: creating. {{(pid=129109) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 13 21:29:50.275891 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-20caa128-0828-4b8d-a34c-a6e586056a57 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:54.545362 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-20caa128-0828-4b8d-a34c-a6e586056a57 tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: created successfully Nov 13 21:29:55.680238 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: deleting Nov 13 21:29:55.695907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: deleting {{(pid=129109) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 13 21:29:55.713863 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:57.136733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['eb1d2d2f-a042-4858-9e27-983f870e5e0f', 'c3cf84f6-0c66-40f1-b821-a5b0fbff2b55', 'ae85a4e4-1a8d-4e59-9859-13d20bed14ec', 'b9ad29cc-7001-4b74-8516-3fbf90173aaa'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:57.302162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:57.323841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:57.345883 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:57.350071 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:29:57.459749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-81ac0d42-9ce6-4f5a-b6ca-84749d601f34 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-fb81807a-b86f-4d49-a57d-cd6913670959-delete_volume'" released by "delete_volume" :: held 9.253s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:29:57.904360 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Created reservations ['580a758d-6ed8-44b4-949c-5cd908e3f37c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:57.922243 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-279102713 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-279102713, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:29:57.923158 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-279102713 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-279102713, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:29:57.961855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9b93e272-894d-4bbd-86b4-40a6727e8228 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-10a1d898-0fa3-49a5-b06c-e58d2a1bd723-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.018s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:29:57.963699 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9b93e272-894d-4bbd-86b4-40a6727e8228 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:58.284716 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Created reservations ['d9de2c17-019a-4146-8261-02eaa5112ea3', '64b7678b-1670-464a-a407-4da2c61897f7', '78b0d519-39b9-4113-9455-1baaa6c7d3f5', 'f7b38e7c-3c33-4c13-8b5b-23bd041f4994'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:58.779506 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:58.829407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:58.852784 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:58.856972 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a22d5515-e9dd-4125-a336-c0b914dff7c5 tempest-GroupsTest-1641933210 None] Delete group completed successfully. Nov 13 21:29:59.134075 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-4ce67b00-1637-436f-92ef-baa08c29773b tempest-GroupsTest-1641933210 None] Created reservations ['4824315c-7981-40e6-bcde-4f1f29878fd7'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:29:59.324712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ce67b00-1637-436f-92ef-baa08c29773b tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:59.351147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ce67b00-1637-436f-92ef-baa08c29773b tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:29:59.374188 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4ce67b00-1637-436f-92ef-baa08c29773b tempest-GroupsTest-1641933210 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:29:59.377968 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4ce67b00-1637-436f-92ef-baa08c29773b tempest-GroupsTest-1641933210 None] Delete group completed successfully. Nov 13 21:30:00.040359 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1706571961 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1706571961, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:30:00.041250 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1706571961 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1706571961, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:30:00.154054 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['50347758-a0ba-4c95-8aca-54c94abf8155', 'ab39ae0b-bd67-4991-859e-4b46f8356ebc', '71e4b4c4-b11e-450f-a361-21d9c5f49672', '0b09a2bf-2344-4d41-b07b-b102543ba700'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:00.456380 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2120bf93-5180-474b-aa9e-996fe395531c tempest-GroupSnapshotsTest-1830456192 None] group_snapshot 6b0270de-fa72-40c0-8e30-ca3cdde2e796: deleted successfully Nov 13 21:30:01.235761 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2fc72bd8-6552-4183-970b-8ca7dd8594a5 tempest-GroupsTest-1641933210 None] Group tempest-GroupsTest-Group-435017338: creating Nov 13 21:30:01.399094 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2fc72bd8-6552-4183-970b-8ca7dd8594a5 tempest-GroupsTest-1641933210 None] Group tempest-GroupsTest-Group-435017338: created successfully Nov 13 21:30:01.424764 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2fc72bd8-6552-4183-970b-8ca7dd8594a5 tempest-GroupsTest-1641933210 None] Create group completed successfully. Nov 13 21:30:01.443239 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:01.730106 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:01.730841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Volume volume-533bac28-a8c5-43bb-a560-5357a6282588 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:01.950999 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] deleting rbd volume volume-533bac28-a8c5-43bb-a560-5357a6282588 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:02.101830 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-9b93e272-894d-4bbd-86b4-40a6727e8228 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['452c5586-0067-41c2-ae5d-94bdf92cb3bb', '5fe6a527-1c03-4059-80ad-bbfddd56a925', 'a61e2907-20ff-4423-a845-21f9da359f3f', 'fcadd732-86e7-4e8a-8561-3ae516ba905a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:02.342240 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9b93e272-894d-4bbd-86b4-40a6727e8228 tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:30:02.348570 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9b93e272-894d-4bbd-86b4-40a6727e8228 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-10a1d898-0fa3-49a5-b06c-e58d2a1bd723-delete_snapshot'" released by "delete_snapshot" :: held 4.387s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:03.280158 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:03.283801 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:03.284246 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:03.296888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (8a89f708-4cb4-4f9b-9df7-2b1c3e8624cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:03.299857 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1620a80-aef2-4f02-9da6-71787bbfa95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:03.306634 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:03.319016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1620a80-aef2-4f02-9da6-71787bbfa95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1720346973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7c54679-341d-4e3c-b607-c56f381d19bb,host='ncdv-master-1@ceph#ceph',id=907beedc-13ff-49da-9b80-5b9166e11b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f051abab4b4ab9b1ef81698e085b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:03Z,use_quota=True,user_id='6b7188792f15471785dac083ed6fcfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb11fee-9adb-4d07-97f2-6b01593be0dd),volume_type_id=ddb11fee-9adb-4d07-97f2-6b01593be0dd)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:03.321547 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f31bd2-9e25-485b-afeb-37a145a3cc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:03.323667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f31bd2-9e25-485b-afeb-37a145a3cc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:03.326030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00f861d-ba29-49e4-b442-f1d1a9a16276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:03.328208 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00f861d-ba29-49e4-b442-f1d1a9a16276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '907beedc-13ff-49da-9b80-5b9166e11b37', 'volume_name': 'volume-907beedc-13ff-49da-9b80-5b9166e11b37', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:03.330476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53437941-9436-4248-a1a6-7dda6faf03a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:03.332522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53437941-9436-4248-a1a6-7dda6faf03a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:03.334681 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205be218-ecec-42c9-8a00-884086e3611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:03.347252 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Volume 907beedc-13ff-49da-9b80-5b9166e11b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-907beedc-13ff-49da-9b80-5b9166e11b37', 'volume_size': 1} Nov 13 21:30:03.347650 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] creating volume 'volume-907beedc-13ff-49da-9b80-5b9166e11b37' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:03.348629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:03.383871 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-899d57c9-164d-4b4e-b6ec-3e5bec81118c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:03.471405 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:03.733053 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:03.733483 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:04.033703 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-899d57c9-164d-4b4e-b6ec-3e5bec81118c {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:04.259158 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:04.259903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:04.261656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205be218-ecec-42c9-8a00-884086e3611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-907beedc-13ff-49da-9b80-5b9166e11b37', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:04.264105 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4206631f-f06b-426d-bac2-eb59869c1f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:04.357089 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Volume volume-907beedc-13ff-49da-9b80-5b9166e11b37 (907beedc-13ff-49da-9b80-5b9166e11b37): created successfully Nov 13 21:30:04.359894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4206631f-f06b-426d-bac2-eb59869c1f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:04.362917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (8a89f708-4cb4-4f9b-9df7-2b1c3e8624cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:04.473063 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a73259cf-bc83-4f89-995b-b6ec0dc50dd7 tempest-GroupsTest-1641933210 None] Created volume successfully. Nov 13 21:30:06.180438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:06.184719 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:06.185330 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:06.202709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (47736cca-1073-41a0-95b9-c30923d11a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:06.205001 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fb6f02-ffdb-4072-bc11-d20e3ec52e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:06.211917 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:06.224994 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7fb6f02-ffdb-4072-bc11-d20e3ec52e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1525848950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d7c54679-341d-4e3c-b607-c56f381d19bb,host='ncdv-master-1@ceph#ceph',id=d9519c23-cdbc-4ad3-8d41-dbe7dd88905d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f051abab4b4ab9b1ef81698e085b5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:06Z,use_quota=True,user_id='6b7188792f15471785dac083ed6fcfd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddb11fee-9adb-4d07-97f2-6b01593be0dd),volume_type_id=ddb11fee-9adb-4d07-97f2-6b01593be0dd)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:06.228259 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5450151-6c4f-401e-b9c6-7c865fbc25ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:06.230435 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5450151-6c4f-401e-b9c6-7c865fbc25ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:06.232814 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f57e395-0dcd-443e-88b9-658f946bfb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:06.235064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f57e395-0dcd-443e-88b9-658f946bfb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9519c23-cdbc-4ad3-8d41-dbe7dd88905d', 'volume_name': 'volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:06.237374 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081521d9-f213-4084-b9a3-547eeb1a79ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:06.239492 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081521d9-f213-4084-b9a3-547eeb1a79ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:06.242023 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ad2a08-221e-40c6-9ce9-778bc171df3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:06.256280 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Volume d9519c23-cdbc-4ad3-8d41-dbe7dd88905d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d', 'volume_size': 1} Nov 13 21:30:06.256720 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] creating volume 'volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:06.258266 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:07.324594 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:07.325253 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:07.326942 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ad2a08-221e-40c6-9ce9-778bc171df3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:07.329095 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ed970f-b407-425d-8a2b-3db66f61ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:07.384138 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Volume volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d (d9519c23-cdbc-4ad3-8d41-dbe7dd88905d): created successfully Nov 13 21:30:07.386046 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11ed970f-b407-425d-8a2b-3db66f61ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:07.388953 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Flow 'volume_create_manager' (47736cca-1073-41a0-95b9-c30923d11a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:07.469733 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-595bdb79-2a2c-40c9-9715-e5605960766a tempest-GroupsTest-1641933210 None] Created volume successfully. Nov 13 21:30:08.406340 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9814a67e-d0d6-4c12-be7d-91142fcc2b28 tempest-GroupsTest-1641933210 None] Update group completed successfully. Nov 13 21:30:09.709748 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9810a17b-c31d-4d46-b8b8-81f3fcddc812 tempest-GroupsTest-1641933210 None] Update group completed successfully. Nov 13 21:30:09.975422 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['6e3aa48b-e564-4598-ae31-b995a39f84d6'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:09.993155 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1706571961 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1706571961, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:30:10.098775 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Created reservations ['e40b8014-7099-4944-bda2-e25d68580bb6', 'a2dc2aa9-6b1a-4742-b061-c03acf7d5952', '91ac8e91-9f56-4bbf-b4ff-fdf71a0ac087', '9258c0c8-2018-46f8-aa32-6ec69e4947d9'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:10.608919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:10.652319 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:10.709838 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:10.716228 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0975e33f-3773-44c5-beb9-335d46932651 tempest-GroupSnapshotsTest-1830456192 None] Delete group completed successfully. Nov 13 21:30:11.078385 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:11.315609 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:11.316045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Volume volume-907beedc-13ff-49da-9b80-5b9166e11b37 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:11.726351 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] deleting rbd volume volume-907beedc-13ff-49da-9b80-5b9166e11b37 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:11.948556 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['d6bc8dd3-cece-4fb5-8364-208608d8fda5', 'c8f2f632-90cd-4fbd-b629-8c818ecdc7e1', '86d25bce-963d-4195-a164-c0367518ab76', '54194957-f155-4bf7-8a75-b597746a7fcf'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:12.133515 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:12.161361 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:12.192912 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:12.208213 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:30:12.374113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a01a744d-9d48-48b1-a78c-049bddd75281 tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-899d57c9-164d-4b4e-b6ec-3e5bec81118c-delete_volume'" released by "delete_volume" :: held 8.990s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:13.217840 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-d74a6083-10e2-4e37-962d-a7a09b64838e-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:13.331778 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:13.744728 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:14.135236 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-d74a6083-10e2-4e37-962d-a7a09b64838e {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:18.171301 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:30:18.172085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:18.205100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:18.250586 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:19.291277 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:19.294821 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:19.295260 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:19.307904 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Flow 'volume_create_manager' (b55e6eb0-1860-4c91-971b-79bd33386e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:19.310977 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa67665b-e759-4e0b-826e-5b74cfe42945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:19.317145 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:19.329443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa67665b-e759-4e0b-826e-5b74cfe42945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-141101611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e3929cb-85e7-4f30-83b9-3430043f3fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80f2e5ca132490185c55f7172e8cb5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:19Z,use_quota=True,user_id='4d03af4e2a0444e8aa9b964159159a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:19.331873 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d123414-ddcf-47cc-bcdd-74a919542cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:19.333996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d123414-ddcf-47cc-bcdd-74a919542cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:19.336818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5276f8-278d-42dd-ad73-6f6ad680d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:19.338945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5276f8-278d-42dd-ad73-6f6ad680d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3929cb-85e7-4f30-83b9-3430043f3fb2', 'volume_name': 'volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:19.341271 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adba7d07-6d70-4184-8b28-0a9f7f134104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:19.343265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adba7d07-6d70-4184-8b28-0a9f7f134104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:19.345378 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36245d6a-7a02-4218-be04-775cfb06db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:19.346124 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume 6e3929cb-85e7-4f30-83b9-3430043f3fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2', 'volume_size': 1} Nov 13 21:30:19.346503 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] creating volume 'volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:19.347477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:19.586751 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:19.849483 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:19.850677 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Volume volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:20.216488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] deleting rbd volume volume-d9519c23-cdbc-4ad3-8d41-dbe7dd88905d {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:20.501743 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:20.502473 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:20.505020 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36245d6a-7a02-4218-be04-775cfb06db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:20.507957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8628848c-9a71-4cff-b2f2-788e08dea880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:20.629627 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2 (6e3929cb-85e7-4f30-83b9-3430043f3fb2): created successfully Nov 13 21:30:20.631573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8628848c-9a71-4cff-b2f2-788e08dea880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:20.635083 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Flow 'volume_create_manager' (b55e6eb0-1860-4c91-971b-79bd33386e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:20.718431 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-c591a21f-1c41-49aa-a41d-91a956d03d6a tempest-VolumeQuotasAdminTestJSON-867586801 None] Created volume successfully. Nov 13 21:30:21.395026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Lock "b'cinder-6e3929cb-85e7-4f30-83b9-3430043f3fb2-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:21.577645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:21.863979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:21.864349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:22.091364 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] deleting rbd volume volume-6e3929cb-85e7-4f30-83b9-3430043f3fb2 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:22.627698 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:30:22.882794 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] deleting parent snapshot volume-d74a6083-10e2-4e37-962d-a7a09b64838e.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:30:26.922243 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['027b9fa6-4cd0-4188-926c-77fc5d63955f', 'ff4f81b8-4c83-47e4-ad75-33c10f7a4238', '0b8bb176-5d3c-480e-9048-a11017449d30', '31da5398-be8a-4c26-ac15-5f1c3a512421'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:27.156849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:27.178047 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:27.199894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:27.205018 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:30:27.302729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-305dcfce-5ed5-4665-82fb-2b71f6400dab tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-d74a6083-10e2-4e37-962d-a7a09b64838e-delete_volume'" released by "delete_volume" :: held 14.085s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:28.100712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-c2142bca-bb38-401c-8c78-bd81a6e0dc7e tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-8b66b365-3b56-44a4-b89e-7ba19c51aaf3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:28.103195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c2142bca-bb38-401c-8c78-bd81a6e0dc7e tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:29.026637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Created reservations ['a66127c7-2ddb-43aa-a431-df50226bcd36'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:29.042904 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1336995877 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1336995877, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:30:29.043696 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1336995877 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1336995877, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:30:29.161289 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Created reservations ['885c8b49-ed08-4b71-a2b5-3f0a479a9a09', '0117e9f3-7b85-4091-8f2e-51c2c78dd47d', '4be64595-08a2-49cd-8b21-b153357cae65', '3b4a9af5-4b6f-4bed-9b31-dd6f347ccb3b'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:29.587260 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Created reservations ['80d9f9a2-7cd9-4b7f-8944-2c6e96c3f34b', 'dabfb925-0ce1-4005-9705-33676ba10869', '6c199308-0b3d-4c00-ad00-6f22556b21a6', '11089632-68e0-46d9-a83d-9f838d77f5b0'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:30.140957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:30.178455 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:30.212146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:30.216177 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-48ae0a1c-1ff9-4d6f-a04e-122eaca0e729 tempest-GroupsTest-1641933210 None] Delete group completed successfully. Nov 13 21:30:31.013471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Created reservations ['2bd29d1b-768a-441c-8250-c22e8bd501aa', '7a93eadb-61d4-4b00-a0c5-7be9cb4ae104', 'ad220ed1-3575-4a44-9da6-48c5983f2dd5', 'b1ab555d-6ab7-483d-ad47-e2958ea4a6da'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:31.325110 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:31.348528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:31.373528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:31.377490 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Deleted volume successfully. Nov 13 21:30:31.495683 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a492af41-292b-4146-9c7d-90a45af55999 tempest-VolumeQuotasAdminTestJSON-867586801 None] Lock "b'cinder-6e3929cb-85e7-4f30-83b9-3430043f3fb2-delete_volume'" released by "delete_volume" :: held 10.101s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:33.097744 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:33.105663 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:33.106307 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:33.118825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Flow 'volume_create_manager' (d1ee7be7-3c5a-417c-93f0-dac78a35a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:33.127189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4916390-3d13-4fdc-81e7-1d6a6cb80952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.136275 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:33.151094 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4916390-3d13-4fdc-81e7-1d6a6cb80952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1252660075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=adcfbf2e-547f-4891-8bdb-4771dd222ebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80f2e5ca132490185c55f7172e8cb5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:33Z,use_quota=True,user_id='4d03af4e2a0444e8aa9b964159159a8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.153702 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd59d22-94c4-4f92-987c-2748a3ef127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.156544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd59d22-94c4-4f92-987c-2748a3ef127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.158928 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c2db3-676e-4e0a-afe4-5b79972575ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.161115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847c2db3-676e-4e0a-afe4-5b79972575ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adcfbf2e-547f-4891-8bdb-4771dd222ebe', 'volume_name': 'volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.163386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5756d-dfcf-420f-a711-6bf1c99a3c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.165488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea5756d-dfcf-420f-a711-6bf1c99a3c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.167604 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1749a-5b06-4d5a-a77d-5bf3ed0fda9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.168366 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume adcfbf2e-547f-4891-8bdb-4771dd222ebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe', 'volume_size': 1} Nov 13 21:30:33.168782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] creating volume 'volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:33.169749 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:33.337972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:33.343748 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:33.344132 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:33.357530 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Flow 'volume_create_manager' (926dcccd-2980-472d-9f36-3589d2e3496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:33.360918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75443318-d6bb-4e1f-a879-f1f5749d6f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.368815 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:33.381853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75443318-d6bb-4e1f-a879-f1f5749d6f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-332371339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fd586ae1-b83b-4fa5-85e7-a39372323ef1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9383e7c033e4af09a3de1311426e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:33Z,use_quota=True,user_id='2e0a9f23fe2f491f88c957fcec260067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.385825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aa445a-d3a4-43f7-931b-fd1b86a9a7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.388195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0aa445a-d3a4-43f7-931b-fd1b86a9a7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.390819 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2320690-5beb-4c7b-b6fc-8a29c530d3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.393274 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2320690-5beb-4c7b-b6fc-8a29c530d3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd586ae1-b83b-4fa5-85e7-a39372323ef1', 'volume_name': 'volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.396112 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a83ed52-83b3-4fea-80b4-9064c694fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.398402 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a83ed52-83b3-4fea-80b4-9064c694fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:33.401056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4be881-8f42-4b83-ad55-3c2d7dc090b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:33.404655 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume fd586ae1-b83b-4fa5-85e7-a39372323ef1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1', 'volume_size': 1} Nov 13 21:30:33.404655 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] creating volume 'volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:33.404655 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:33.693950 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-c2142bca-bb38-401c-8c78-bd81a6e0dc7e tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['e49fab10-3dc5-439b-8540-f1ddc876b9fc', 'e168a678-d6c8-4dbb-aebb-f0fbfecce6e1', '56af359c-2946-4b87-ba64-658a00aaa048', '65ec1e8d-ca36-4ff7-ae39-00a9540045a0'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:34.067140 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-c2142bca-bb38-401c-8c78-bd81a6e0dc7e tempest-VolumesSnapshotTestJSON-1404067749 None] Delete snapshot completed successfully. Nov 13 21:30:34.072018 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-c2142bca-bb38-401c-8c78-bd81a6e0dc7e tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-8b66b365-3b56-44a4-b89e-7ba19c51aaf3-delete_snapshot'" released by "delete_snapshot" :: held 5.972s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:34.782546 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:34.783463 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:34.785344 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b1749a-5b06-4d5a-a77d-5bf3ed0fda9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:34.787678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824aa24-d770-4c6b-9af0-206ed48eaff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:34.942923 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Volume volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe (adcfbf2e-547f-4891-8bdb-4771dd222ebe): created successfully Nov 13 21:30:34.947182 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8824aa24-d770-4c6b-9af0-206ed48eaff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:34.953562 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Flow 'volume_create_manager' (d1ee7be7-3c5a-417c-93f0-dac78a35a871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:35.065266 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-6c153bc1-b7bd-451c-8f93-eb637acb67b6-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:35.110824 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1d0fe515-c599-48ac-a75c-e6ab16ca3c43 tempest-VolumeQuotasAdminTestJSON-867586801 None] Created volume successfully. Nov 13 21:30:35.140341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:35.142215 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:35.149564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f4be881-8f42-4b83-ad55-3c2d7dc090b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:35.151858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd582823-4aaa-41c4-b8b9-188119b54130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:35.203539 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:35.512461 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:35.512860 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Volume volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:35.988068 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] deleting rbd volume volume-6c153bc1-b7bd-451c-8f93-eb637acb67b6 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:35.994397 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1 (fd586ae1-b83b-4fa5-85e7-a39372323ef1): created successfully Nov 13 21:30:35.996372 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd582823-4aaa-41c4-b8b9-188119b54130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:35.999406 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Flow 'volume_create_manager' (926dcccd-2980-472d-9f36-3589d2e3496e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:36.138998 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-54ea8aef-d1a4-48bf-86a6-e12ee727913f tempest-ServerRescueNegativeTestJSON-1445126235 None] Created volume successfully. Nov 13 21:30:37.463682 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-69e7627d-3b02-4574-a7dc-edb0bdba492b tempest-VolumeQuotasAdminTestJSON-1619190474 None] Transfer volume completed successfully. Nov 13 21:30:38.530500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Lock "b'cinder-adcfbf2e-547f-4891-8bdb-4771dd222ebe-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:38.761981 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:39.319162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:30:39.320292 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Volume volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:30:39.612962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] deleting rbd volume volume-adcfbf2e-547f-4891-8bdb-4771dd222ebe {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:30:42.212075 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:42.215617 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:42.216078 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:42.230565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Flow 'volume_create_manager' (b90638f2-02b4-42c7-8427-1ce55fcd9755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:42.233596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c624d-555a-484a-a91d-f7af49d0bc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:42.239554 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:42.252530 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352c624d-555a-484a-a91d-f7af49d0bc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-627990872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e378abcf-b451-4238-a036-755e32326427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ca625585c148b9972b766a3d47c39d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:42Z,use_quota=True,user_id='6484a520e9834ed4ae889526f1748601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:42.255194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c8a140-2fa4-4cc3-b499-6da78e48a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:42.257593 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c8a140-2fa4-4cc3-b499-6da78e48a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:42.259975 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f6cc4e-fe48-4223-b07a-6251a54cd6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:42.262153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f6cc4e-fe48-4223-b07a-6251a54cd6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e378abcf-b451-4238-a036-755e32326427', 'volume_name': 'volume-e378abcf-b451-4238-a036-755e32326427', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:42.264349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8313d261-69bc-4141-ad32-8c3e0cbe154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:42.266396 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8313d261-69bc-4141-ad32-8c3e0cbe154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:42.268544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03db2bb7-900a-4294-b62b-b945006d05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:42.269331 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Volume e378abcf-b451-4238-a036-755e32326427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e378abcf-b451-4238-a036-755e32326427', 'volume_size': 1} Nov 13 21:30:42.269719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] creating volume 'volume-e378abcf-b451-4238-a036-755e32326427' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:42.271779 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:43.389976 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:43.390595 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:43.392564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03db2bb7-900a-4294-b62b-b945006d05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e378abcf-b451-4238-a036-755e32326427', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:43.395628 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c72f244-b5fc-48b9-bf06-5a3a5d90f65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:43.490014 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Volume volume-e378abcf-b451-4238-a036-755e32326427 (e378abcf-b451-4238-a036-755e32326427): created successfully Nov 13 21:30:43.492226 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c72f244-b5fc-48b9-bf06-5a3a5d90f65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:43.495231 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Flow 'volume_create_manager' (b90638f2-02b4-42c7-8427-1ce55fcd9755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:43.593089 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-34629d63-1b80-4e68-9ae6-d08cde5e2943 tempest-VolumesBackupsV39Test-1128315970 None] Created volume successfully. Nov 13 21:30:44.798818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Created reservations ['becc5888-b4b4-4cbb-af4a-dae42c0bbbff', 'f5b8d89e-0cde-4faf-a15c-a6686b960bb4', '0b75facf-d9dd-4bce-a748-7bb026ee3798', '36c0aa59-cf8e-4b25-8fc4-a7b4e4411fd4'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:45.045682 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:30:45.070526 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:45.096118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:45.124261 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:45.129874 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Deleted volume successfully. Nov 13 21:30:45.199302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-ef297f3d-a2cd-4287-b6b8-56536b3497bb tempest-VolumesSnapshotTestJSON-1404067749 None] Lock "b'cinder-6c153bc1-b7bd-451c-8f93-eb637acb67b6-delete_volume'" released by "delete_volume" :: held 10.134s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:45.802698 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.757s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:30:45.803614 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e378abcf-b451-4238-a036-755e32326427', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'e378abcf-b451-4238-a036-755e32326427', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:30:45.818210 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] Initialize volume connection completed successfully. Nov 13 21:30:48.598969 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Created reservations ['bc8b58a3-884b-4974-a18f-9128bb3b1e7a', 'f42ccf9f-c4f5-4bd7-8ffd-65c02f704802', '2ced2943-4677-403f-9c19-dc1e523df5e5', 'c385daa8-8d64-4d63-b714-7a90491cf526'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:30:48.759439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:48.859567 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:48.896649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:30:48.906957 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Deleted volume successfully. Nov 13 21:30:48.997978 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f7e3307a-4f10-4fb8-8b8c-194a99c21965 tempest-VolumeQuotasAdminTestJSON-1879558588 None] Lock "b'cinder-adcfbf2e-547f-4891-8bdb-4771dd222ebe-delete_volume'" released by "delete_volume" :: held 10.467s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:30:49.923945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:49.927900 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:49.928496 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:49.941293 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Flow 'volume_create_manager' (8b6eba41-57b6-44e9-9735-f5900062e7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:49.944448 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4820a2a3-0330-4a19-b8f7-42ac91d2b555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:49.953232 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:49.970660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4820a2a3-0330-4a19-b8f7-42ac91d2b555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1601687502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6cfe7892-87ed-40bd-b827-08190128a55d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a45af1a285cc46c4a847bd3733db8aea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:50Z,use_quota=True,user_id='930612debd3a406ea13555b05fc1e876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:49.978062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f0b79f-0675-43fe-b87e-3af2a1d1f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:49.978062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f0b79f-0675-43fe-b87e-3af2a1d1f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:49.980020 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c274abed-eab1-4308-9a8d-53ea2e2c2041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:49.982262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c274abed-eab1-4308-9a8d-53ea2e2c2041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfe7892-87ed-40bd-b827-08190128a55d', 'volume_name': 'volume-6cfe7892-87ed-40bd-b827-08190128a55d', 'volume_size': 2}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:49.984502 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385e9b55-af45-4605-8060-ebbc04a9d022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:49.986580 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385e9b55-af45-4605-8060-ebbc04a9d022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:49.989405 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e567f392-ee87-4ed7-8f8c-60270b60f973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:49.990294 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Volume 6cfe7892-87ed-40bd-b827-08190128a55d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfe7892-87ed-40bd-b827-08190128a55d', 'volume_size': 2} Nov 13 21:30:49.990571 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] creating volume 'volume-6cfe7892-87ed-40bd-b827-08190128a55d' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:49.992371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:51.505233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:51.505888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:51.507889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e567f392-ee87-4ed7-8f8c-60270b60f973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfe7892-87ed-40bd-b827-08190128a55d', 'volume_size': 2}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:51.510871 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a3ade9-d329-418a-9ae1-43bdfdcd6052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:51.659360 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Volume volume-6cfe7892-87ed-40bd-b827-08190128a55d (6cfe7892-87ed-40bd-b827-08190128a55d): created successfully Nov 13 21:30:51.661401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a3ade9-d329-418a-9ae1-43bdfdcd6052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:51.664356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Flow 'volume_create_manager' (8b6eba41-57b6-44e9-9735-f5900062e7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:51.807948 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8fb45f90-6ad3-45d4-b862-339ede1f9b36 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Created volume successfully. Nov 13 21:30:53.639192 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ea87edf-a85f-46dd-9203-ad8a79684157 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:54.132766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:54.136315 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:54.136773 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:54.149763 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Flow 'volume_create_manager' (a4a77020-f4cf-4530-9176-57ad21411361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:54.155905 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83406706-fa45-47f8-93c5-6e5761d2952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:54.162427 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:54.203534 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83406706-fa45-47f8-93c5-6e5761d2952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-315222305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd247ede-f730-48b7-8b66-aa1abcc38904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9383e7c033e4af09a3de1311426e629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:54Z,use_quota=True,user_id='2e0a9f23fe2f491f88c957fcec260067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:54.207900 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df0dede-0c74-4ec9-aef2-a84ac0cb60ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:54.212666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7df0dede-0c74-4ec9-aef2-a84ac0cb60ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:54.212666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2d6239-cd4a-4869-9ddc-abf48d3a7505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:54.214512 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad2d6239-cd4a-4869-9ddc-abf48d3a7505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd247ede-f730-48b7-8b66-aa1abcc38904', 'volume_name': 'volume-dd247ede-f730-48b7-8b66-aa1abcc38904', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:54.216936 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f60b78-433a-4d1c-8a43-51d8d888793c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:54.219037 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77f60b78-433a-4d1c-8a43-51d8d888793c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:54.221247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebbe7d9-6a79-40f4-bf85-df0bc41824df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:54.222020 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume dd247ede-f730-48b7-8b66-aa1abcc38904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd247ede-f730-48b7-8b66-aa1abcc38904', 'volume_size': 1} Nov 13 21:30:54.222855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] creating volume 'volume-dd247ede-f730-48b7-8b66-aa1abcc38904' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:54.223405 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:55.480011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:55.480801 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:55.482629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aebbe7d9-6a79-40f4-bf85-df0bc41824df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd247ede-f730-48b7-8b66-aa1abcc38904', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:55.484719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7cd84e-7f05-465d-a0bb-18c9802b0502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:55.597430 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume volume-dd247ede-f730-48b7-8b66-aa1abcc38904 (dd247ede-f730-48b7-8b66-aa1abcc38904): created successfully Nov 13 21:30:55.597430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7cd84e-7f05-465d-a0bb-18c9802b0502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:55.597430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Flow 'volume_create_manager' (a4a77020-f4cf-4530-9176-57ad21411361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:55.685870 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-566ab72d-b260-4c67-94b1-29faf62ee42f tempest-ServerRescueNegativeTestJSON-1445126235 None] Created volume successfully. Nov 13 21:30:56.283395 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] Terminate volume connection completed successfully. Nov 13 21:30:56.301484 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-718c498d-032f-4c57-9cfd-d85938356b87 tempest-VolumesBackupsV39Test-1128315970 None] Remove volume export completed successfully. Nov 13 21:30:57.449505 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-588a0f9b-56f1-4de2-9597-40ca7ba17269 req-a3732682-62bb-412c-ac4a-fb3ba066b935 tempest-ServerRescueNegativeTestJSON-1445126235 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:30:57.804545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:30:57.809016 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:30:57.809541 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:30:57.822038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (e9209ff5-948d-49b2-908c-efed30b3f51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:57.825468 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c66986-cb54-4283-b37a-de081621c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:57.832069 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:30:57.845427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0c66986-cb54-4283-b37a-de081621c60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-705300509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7309cb3a-c938-400f-9ae4-c05d4eacaafc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c47ce47947b597b74f7ee190061c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:30:58Z,use_quota=True,user_id='76fb4ea1548d401fafd9f7c9caaef5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:57.848154 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baecd3a3-0d95-4664-a1b6-c23d102f33fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:57.850224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baecd3a3-0d95-4664-a1b6-c23d102f33fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:57.852576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9944fcc-d957-4c27-954d-6535b144416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:57.855315 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9944fcc-d957-4c27-954d-6535b144416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'volume_name': 'volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:57.857560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd20c7-4ea3-49c0-954d-3478decb4047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:57.859581 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9dd20c7-4ea3-49c0-954d-3478decb4047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:57.862687 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e9909-7db3-4438-98b7-f4b913314665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:57.862687 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Volume 7309cb3a-c938-400f-9ae4-c05d4eacaafc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'volume_size': 1} Nov 13 21:30:57.862910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] creating volume 'volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:30:57.863925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:58.068106 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3ea87edf-a85f-46dd-9203-ad8a79684157 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Create snapshot completed successfully Nov 13 21:30:58.216401 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-588a0f9b-56f1-4de2-9597-40ca7ba17269 req-a3732682-62bb-412c-ac4a-fb3ba066b935 tempest-ServerRescueNegativeTestJSON-1445126235 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.767s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:30:58.217060 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-588a0f9b-56f1-4de2-9597-40ca7ba17269 req-a3732682-62bb-412c-ac4a-fb3ba066b935 tempest-ServerRescueNegativeTestJSON-1445126235 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dd247ede-f730-48b7-8b66-aa1abcc38904', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'dd247ede-f730-48b7-8b66-aa1abcc38904', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:30:58.323401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-588a0f9b-56f1-4de2-9597-40ca7ba17269 req-a3732682-62bb-412c-ac4a-fb3ba066b935 tempest-ServerRescueNegativeTestJSON-1445126235 None] Connection info returned from driver {'name': 'volumes/volume-dd247ede-f730-48b7-8b66-aa1abcc38904', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dd247ede-f730-48b7-8b66-aa1abcc38904', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bb0f8e3e-53bb-464a-b9ff-737021b1bd0b'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:30:58.435219 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-588a0f9b-56f1-4de2-9597-40ca7ba17269 req-a3732682-62bb-412c-ac4a-fb3ba066b935 tempest-ServerRescueNegativeTestJSON-1445126235 None] attachment_update completed successfully. Nov 13 21:30:58.739089 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-12ac5d24-10eb-412c-87f7-7fd6adf43353 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Lock "b'cinder-260e1e7a-fd98-46d5-9295-6ae08a3af9d5-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:30:58.740651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-12ac5d24-10eb-412c-87f7-7fd6adf43353 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:30:58.942697 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:30:58.942970 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:30:58.944982 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07e9909-7db3-4438-98b7-f4b913314665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:58.947479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dab94b-4189-4e26-a39e-f6c05dc83cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:30:59.048052 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc (7309cb3a-c938-400f-9ae4-c05d4eacaafc): created successfully Nov 13 21:30:59.050561 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92dab94b-4189-4e26-a39e-f6c05dc83cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:30:59.054180 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (e9209ff5-948d-49b2-908c-efed30b3f51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:30:59.227512 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f3397ddd-fdba-4479-8c8e-9ac5de430a75 tempest-VolumesBackupsAdminTest-1301942349 None] Created volume successfully. Nov 13 21:31:00.258181 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:31:00.919855 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.661s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:31:00.920542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '7309cb3a-c938-400f-9ae4-c05d4eacaafc', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:31:00.935290 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] Initialize volume connection completed successfully. Nov 13 21:31:03.551118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-12ac5d24-10eb-412c-87f7-7fd6adf43353 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Created reservations ['4383ef55-7738-4f86-8422-e0f4d9c9cfa9', 'd8aa42c2-0b55-452f-825b-3aedd80b1ac9', '75e72f7c-9824-4e49-9997-b1978ca4163b', '8a81d235-5fd5-4f45-8d57-ba645fd2db29'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:03.725442 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-12ac5d24-10eb-412c-87f7-7fd6adf43353 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Delete snapshot completed successfully. Nov 13 21:31:03.731409 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-12ac5d24-10eb-412c-87f7-7fd6adf43353 tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Lock "b'cinder-260e1e7a-fd98-46d5-9295-6ae08a3af9d5-delete_snapshot'" released by "delete_snapshot" :: held 4.992s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:04.130148 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Lock "b'cinder-6cfe7892-87ed-40bd-b827-08190128a55d-delete_volume'" acquired by "delete_volume" :: waited 0.029s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:04.234613 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:05.008979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:31:05.009633 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Volume volume-6cfe7892-87ed-40bd-b827-08190128a55d is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:05.280921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] deleting rbd volume volume-6cfe7892-87ed-40bd-b827-08190128a55d {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:09.234221 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] Terminate volume connection completed successfully. Nov 13 21:31:09.254256 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-57c2da14-a084-49b7-8e00-094e73425f44 tempest-VolumesBackupsAdminTest-1301942349 None] Remove volume export completed successfully. Nov 13 21:31:11.163073 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Lock "b'cinder-e378abcf-b451-4238-a036-755e32326427-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:11.318240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:13.955090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Volume volume-e378abcf-b451-4238-a036-755e32326427 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:14.757800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] deleting rbd volume volume-e378abcf-b451-4238-a036-755e32326427 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:14.858940 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:14.862941 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:14.867347 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:14.876892 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (af56057c-232b-4d8e-b267-8489fc571644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:14.880282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb59e031-62c9-493d-82dc-7ecbd1c31d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:14.888946 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:14.892855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Created reservations ['67937b70-bb9d-41a3-8513-1d2b63e35a5c', 'a43daf18-ec89-44d3-9ed2-3bd2baf7ba3e', '4b4c260f-8093-495a-a97a-b11a6e9b1e14', 'ac04fb93-5a0a-4e36-936c-c8b25fdb6177'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:14.911204 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb59e031-62c9-493d-82dc-7ecbd1c31d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:12Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_00abc107-9c6f-412d-9244-d0c53ba82ff6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c47ce47947b597b74f7ee190061c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:13Z,use_quota=True,user_id='76fb4ea1548d401fafd9f7c9caaef5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:14.913791 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8a1c6e-589e-46f9-916b-334c41c432ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:14.915923 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8a1c6e-589e-46f9-916b-334c41c432ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:14.918827 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9587cb4b-3151-47d3-9f05-8083e79317fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:14.921059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9587cb4b-3151-47d3-9f05-8083e79317fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'volume_name': 'volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:14.923244 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abadaf5-8810-4b1c-bba2-82bb03d914b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:14.925301 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abadaf5-8810-4b1c-bba2-82bb03d914b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:14.927394 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc19b31-043a-4461-a070-20ebe69a0fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:14.928149 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Volume 6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'volume_size': 1} Nov 13 21:31:14.936297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] creating volume 'volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:31:14.936297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:15.169751 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:15.193657 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:15.218434 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:15.223517 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Deleted volume successfully. Nov 13 21:31:15.305972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f396bd05-5b1a-4fbf-ae75-b28a89137abe tempest-VolumesSnapshotNegativeTestJSON-1167932460 None] Lock "b'cinder-6cfe7892-87ed-40bd-b827-08190128a55d-delete_volume'" released by "delete_volume" :: held 11.173s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:15.933865 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:31:15.934242 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:31:15.936305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc19b31-043a-4461-a070-20ebe69a0fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:15.938462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cdd43c-6200-4c05-9d4e-713aa18cabb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:16.072580 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9 (6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9): created successfully Nov 13 21:31:16.075344 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cdd43c-6200-4c05-9d4e-713aa18cabb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:16.085919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (af56057c-232b-4d8e-b267-8489fc571644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:16.180569 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Created volume successfully. Nov 13 21:31:17.274418 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:31:17.947631 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.673s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:31:17.948304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:31:17.962590 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Initialize volume connection completed successfully. Nov 13 21:31:18.176734 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:31:18.177690 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:18.204864 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:18.231084 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:21.579045 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Terminate volume connection completed successfully. Nov 13 21:31:21.595329 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5599a462-7f34-4b40-9454-61a748031090 tempest-VolumesBackupsAdminTest-1301942349 None] Remove volume export completed successfully. Nov 13 21:31:22.074886 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Created reservations ['9f4c6be2-cffd-4c1e-830b-6ba39ae95986', '913adc58-ba26-4a01-a3ce-aef5962fac21', 'febfecd9-38f6-4484-8c45-fe41863c0f59', '759d50c0-9e96-49f0-aef4-70940433f61c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:22.383550 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:22.410503 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:22.450178 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:22.456639 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Deleted volume successfully. Nov 13 21:31:22.556023 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-499c8928-6471-41d3-b0c5-907b9acefdf3 tempest-VolumesBackupsV39Test-1128315970 None] Lock "b'cinder-e378abcf-b451-4238-a036-755e32326427-delete_volume'" released by "delete_volume" :: held 11.390s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:22.629640 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:22.750064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:26.447343 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:27.238522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] deleting rbd volume volume-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:27.268238 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-429bd724-f197-4cd7-84c6-2c8c23ce58e7 req-30588334-a484-438a-8136-d7cc1809147b tempest-ServerRescueNegativeTestJSON-1445126235 None] Terminate volume connection completed successfully. Nov 13 21:31:27.268666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-429bd724-f197-4cd7-84c6-2c8c23ce58e7 req-30588334-a484-438a-8136-d7cc1809147b tempest-ServerRescueNegativeTestJSON-1445126235 None] Deleting attachment bb0f8e3e-53bb-464a-b9ff-737021b1bd0b. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:31:27.454035 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:27.457991 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:27.458461 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:27.471559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (9dc863f6-1bfe-4358-b170-55017da22b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:27.474745 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a56e0a3-2e0b-46e3-8c55-c1dbdf59a18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:27.481953 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:27.495569 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a56e0a3-2e0b-46e3-8c55-c1dbdf59a18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-386722122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=72b84c19-4a4f-4f99-b4d7-19bd65d65a44,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:26Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:27.498339 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed06e3ea-fd33-4be3-a624-11b3632e48fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:27.500421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed06e3ea-fd33-4be3-a624-11b3632e48fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:27.502736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd7bb48-7c6b-41a5-9f08-6f003b78f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:27.505162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd7bb48-7c6b-41a5-9f08-6f003b78f138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b84c19-4a4f-4f99-b4d7-19bd65d65a44', 'volume_name': 'volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:27.507423 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d1b74f-3cbf-4898-9067-5f3a217787a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:27.509641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d1b74f-3cbf-4898-9067-5f3a217787a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:27.512317 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca3451e-cfd6-421b-b895-b648fe0ab620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:27.513112 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Volume 72b84c19-4a4f-4f99-b4d7-19bd65d65a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44', 'volume_size': 1} Nov 13 21:31:27.513667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] creating volume 'volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:31:27.514650 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:28.593641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:31:28.594164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:31:28.596420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ca3451e-cfd6-421b-b895-b648fe0ab620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:28.598651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cba783-b556-457a-84c0-aa26be90f66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:28.694647 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Volume volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44 (72b84c19-4a4f-4f99-b4d7-19bd65d65a44): created successfully Nov 13 21:31:28.696584 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9cba783-b556-457a-84c0-aa26be90f66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:28.699614 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (9dc863f6-1bfe-4358-b170-55017da22b2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:28.849116 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cab96da0-b3ab-4a86-a298-f6aa2b8b1d50 tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:31:28.887581 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Lock "b'cinder-dd247ede-f730-48b7-8b66-aa1abcc38904-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:29.008254 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:29.278646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:31:29.279263 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume volume-dd247ede-f730-48b7-8b66-aa1abcc38904 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:29.623661 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] deleting rbd volume volume-dd247ede-f730-48b7-8b66-aa1abcc38904 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:30.521412 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:30.525052 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:30.525524 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:30.540268 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (7270b7e1-4721-4b85-9851-b3948fc8b70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:30.543400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aa3ed-55e0-452e-aca5-71a1ae405ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:30.551820 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:30.565747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a88aa3ed-55e0-452e-aca5-71a1ae405ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-141743438',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a705b476-0fe9-43f5-b258-cc735140e19f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:30Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:30.568282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643a3453-db8b-45ac-8276-5ca0f8823abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:30.570412 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643a3453-db8b-45ac-8276-5ca0f8823abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:30.575237 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd816619-76a6-43f3-af4c-2b8ca1fac8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:30.575738 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd816619-76a6-43f3-af4c-2b8ca1fac8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a705b476-0fe9-43f5-b258-cc735140e19f', 'volume_name': 'volume-a705b476-0fe9-43f5-b258-cc735140e19f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:30.578002 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61cee6c-655e-42b5-a3fa-541292452de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:30.580053 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b61cee6c-655e-42b5-a3fa-541292452de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:30.582201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fbb9e3-be8b-4675-ab9f-edadf023164a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:30.582966 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Volume a705b476-0fe9-43f5-b258-cc735140e19f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a705b476-0fe9-43f5-b258-cc735140e19f', 'volume_size': 1} Nov 13 21:31:30.583407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] creating volume 'volume-a705b476-0fe9-43f5-b258-cc735140e19f' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:31:30.584465 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:31.726718 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:31:31.727386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:31:31.729127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fbb9e3-be8b-4675-ab9f-edadf023164a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a705b476-0fe9-43f5-b258-cc735140e19f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:31.731850 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c963b0-1a50-4cb4-b0f6-d938a2878516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:31.817095 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Volume volume-a705b476-0fe9-43f5-b258-cc735140e19f (a705b476-0fe9-43f5-b258-cc735140e19f): created successfully Nov 13 21:31:31.818917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c963b0-1a50-4cb4-b0f6-d938a2878516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:31.821747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (7270b7e1-4721-4b85-9851-b3948fc8b70e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:31.883312 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9ecd4992-4eb7-4aa4-81d9-13dff500147d tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:31:32.624894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-a705b476-0fe9-43f5-b258-cc735140e19f-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:32.717896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:32.923073 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:31:32.923708 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Volume volume-a705b476-0fe9-43f5-b258-cc735140e19f is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:33.262637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-a705b476-0fe9-43f5-b258-cc735140e19f {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:35.508802 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Created reservations ['2df2c121-2a85-4024-8351-5d53b64f577d', 'e42a0bef-e17e-4e31-b6af-a086c0c97ae8', '85725360-4e78-4fc0-a99c-c989b1d7d797', 'c8d4b6db-f9eb-4159-8afa-c302fff38233'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:35.823280 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:35.852276 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:35.977845 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:35.982428 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Deleted volume successfully. Nov 13 21:31:36.052095 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-44314f5b-abac-4407-b99c-2685e6b7bd25 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-6e5a78f2-6fb5-4d7a-a91e-5ec97a8e40e9-delete_volume'" released by "delete_volume" :: held 13.423s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:38.091686 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Created reservations ['187fc762-4ae6-4896-bfa5-39441874a52f', 'e474a556-e103-440b-81b7-0d6a959c1173', '4bd52e00-583f-4dad-943f-d9b5c30865e8', '7ced58d8-7a57-452c-8ba6-17821e4be954'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:38.289929 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:38.317445 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:38.348964 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:38.355315 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:38.358749 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:38.359194 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:38.371745 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (a83dcd23-12b5-4c9d-82fc-7343cbefbaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:38.375343 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c1afe4-e071-46ff-a350-2e7881744bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:38.378130 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Deleted volume successfully. Nov 13 21:31:38.384087 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:38.400002 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c1afe4-e071-46ff-a350-2e7881744bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-520279498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f3e95b9a-c4bb-4361-967e-b96869e60543,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e587c47ce47947b597b74f7ee190061c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:38Z,use_quota=True,user_id='76fb4ea1548d401fafd9f7c9caaef5b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:38.402603 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fb4841-7713-483b-b128-64f2c874f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:38.404831 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fb4841-7713-483b-b128-64f2c874f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:38.407205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9744c0-ced2-407c-b449-d1df80ca5b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:38.409319 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d9744c0-ced2-407c-b449-d1df80ca5b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3e95b9a-c4bb-4361-967e-b96869e60543', 'volume_name': 'volume-f3e95b9a-c4bb-4361-967e-b96869e60543', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:38.411588 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb74befd-3e0c-426f-b197-0901b44b89bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:38.413738 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb74befd-3e0c-426f-b197-0901b44b89bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:38.415866 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6c4915-b10c-45a6-ba8e-b3d18c1b2c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:38.416622 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Volume f3e95b9a-c4bb-4361-967e-b96869e60543: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3e95b9a-c4bb-4361-967e-b96869e60543', 'volume_size': 1} Nov 13 21:31:38.417047 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] creating volume 'volume-f3e95b9a-c4bb-4361-967e-b96869e60543' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:31:38.418006 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:38.514961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-865672ce-464e-4579-949c-95c669168970 tempest-ServerRescueNegativeTestJSON-1445126235 None] Lock "b'cinder-dd247ede-f730-48b7-8b66-aa1abcc38904-delete_volume'" released by "delete_volume" :: held 9.627s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:38.553990 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Lock "b'cinder-fd586ae1-b83b-4fa5-85e7-a39372323ef1-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:38.668169 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:38.994091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:31:38.994781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Volume volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:39.219458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] deleting rbd volume volume-fd586ae1-b83b-4fa5-85e7-a39372323ef1 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:39.455961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:31:39.456280 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:31:39.458328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6c4915-b10c-45a6-ba8e-b3d18c1b2c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3e95b9a-c4bb-4361-967e-b96869e60543', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:39.462048 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2257906c-168e-42b5-9370-5d9146491cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:39.531350 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-f3e95b9a-c4bb-4361-967e-b96869e60543 (f3e95b9a-c4bb-4361-967e-b96869e60543): created successfully Nov 13 21:31:39.533349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2257906c-168e-42b5-9370-5d9146491cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:39.536833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Flow 'volume_create_manager' (a83dcd23-12b5-4c9d-82fc-7343cbefbaa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:39.598048 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7647d924-7724-4685-afb1-0b70527fdec0 tempest-VolumesBackupsAdminTest-1301942349 None] Created volume successfully. Nov 13 21:31:41.123111 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:31:41.474956 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Created reservations ['5012a6c1-9ebd-4289-98d4-0a43f5be0113', '78938566-0f9b-4ee8-a80b-291013eb1ae5', 'bd1e75f3-3eaa-4c7e-91f5-17b1855fc669', '84be6d0d-d83e-4e2b-b910-830d8362f81e'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:41.795464 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:41.824601 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:41.880350 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:41.885512 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:31:41.897309 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.774s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:31:41.898118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f3e95b9a-c4bb-4361-967e-b96869e60543', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'f3e95b9a-c4bb-4361-967e-b96869e60543', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:31:41.914093 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] Initialize volume connection completed successfully. Nov 13 21:31:41.955194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4ec9e50c-fafd-413e-a1a5-806057a9c1d9 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-a705b476-0fe9-43f5-b258-cc735140e19f-delete_volume'" released by "delete_volume" :: held 9.329s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:42.337937 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Lock "b'cinder-72b84c19-4a4f-4f99-b4d7-19bd65d65a44-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:31:42.473198 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:42.764679 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:31:42.764679 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Volume volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:31:42.993226 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-72b84c19-4a4f-4f99-b4d7-19bd65d65a44 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:31:47.809710 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Created reservations ['93b4e997-717e-44e1-9a2a-cdcfdbfbe732', '72e47f9b-ec9c-4a49-a0bd-ff39985cdf00', '2c013c54-3229-4d91-9dbd-9038fc007f58', '78726c9a-49df-456c-a144-c6c92403337f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:48.016403 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:48.040149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:48.063849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:48.067947 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Deleted volume successfully. Nov 13 21:31:48.191573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-01a06eda-7f56-47c4-a83c-4d8eb70f121c tempest-ServerRescueNegativeTestJSON-1445126235 None] Lock "b'cinder-fd586ae1-b83b-4fa5-85e7-a39372323ef1-delete_volume'" released by "delete_volume" :: held 9.639s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:50.963331 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] Terminate volume connection completed successfully. Nov 13 21:31:50.984139 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fa1f9d9b-63ac-442b-ae88-232e3edbe848 tempest-VolumesBackupsAdminTest-1301942349 None] Remove volume export completed successfully. Nov 13 21:31:51.181377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Created reservations ['e57d008b-172d-4534-ab4c-35274bfc3434', '3d4fda53-c11b-445c-a00c-2f68986fe0bf', '48da8400-a682-42e7-9b18-a999bd1880ce', '7931bdae-0a9b-41e9-a770-edaa755ce9cb'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:31:51.398930 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:51.439745 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:51.468290 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:31:51.472014 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:31:51.559421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-070618cc-2db7-4c35-9010-08a90af60f3f tempest-VolumesGetTest-651263124 None] Lock "b'cinder-72b84c19-4a4f-4f99-b4d7-19bd65d65a44-delete_volume'" released by "delete_volume" :: held 9.223s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:31:53.119436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:53.123418 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:53.123903 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:53.136936 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (d1178403-314c-4b3e-ac3b-af006531b6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:53.140093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3da9d5-5de6-40fc-8a1f-8cb12686cb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:53.147039 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:53.160155 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a3da9d5-5de6-40fc-8a1f-8cb12686cb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-901105865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=faced0bd-b2a4-49f7-b940-74b6601b67ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:53Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:53.162733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80805cf8-ae68-4577-9116-e47978875872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:53.164864 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80805cf8-ae68-4577-9116-e47978875872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:53.167183 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b73d40-4fad-4d65-a3c0-c5284ed3d849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:53.169408 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b73d40-4fad-4d65-a3c0-c5284ed3d849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faced0bd-b2a4-49f7-b940-74b6601b67ec', 'volume_name': 'volume-faced0bd-b2a4-49f7-b940-74b6601b67ec', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:53.178173 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0fa0b-ad05-4154-9791-7e3e3d3716cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:53.178173 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a0fa0b-ad05-4154-9791-7e3e3d3716cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:53.178173 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383fbcb5-1c5c-469b-b5dc-f01e12dde5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:53.178173 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Volume faced0bd-b2a4-49f7-b940-74b6601b67ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faced0bd-b2a4-49f7-b940-74b6601b67ec', 'volume_size': 1} Nov 13 21:31:53.178557 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] creating volume 'volume-faced0bd-b2a4-49f7-b940-74b6601b67ec' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:31:53.178557 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:54.409386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:31:54.410060 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:31:54.411687 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (383fbcb5-1c5c-469b-b5dc-f01e12dde5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faced0bd-b2a4-49f7-b940-74b6601b67ec', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:54.413875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c28fd7d-827b-4149-af70-09979d8e886c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:54.525917 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Volume volume-faced0bd-b2a4-49f7-b940-74b6601b67ec (faced0bd-b2a4-49f7-b940-74b6601b67ec): created successfully Nov 13 21:31:54.528058 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c28fd7d-827b-4149-af70-09979d8e886c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:54.531038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (d1178403-314c-4b3e-ac3b-af006531b6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:54.657555 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-560fd85d-cddd-4ec7-861a-47e82e2860b8 tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:31:55.759322 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:31:55.762614 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:31:55.763281 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:31:55.787103 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (4c464fac-8827-4eff-aa71-a75376f5ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:31:55.791175 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59647d06-8859-4807-a54b-1698228d806a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:55.796360 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:31:55.811419 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59647d06-8859-4807-a54b-1698228d806a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-880419399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4df94390-c07e-496c-808c-3bf9f89a377c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=faced0bd-b2a4-49f7-b940-74b6601b67ec,status='creating',terminated_at=None,updated_at=2021-11-13T21:31:56Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:55.814153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ff353f-f72f-4285-9e8d-d9f1c8ddb5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:55.816042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45ff353f-f72f-4285-9e8d-d9f1c8ddb5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:55.818343 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07cd7bc-62de-4294-8a82-ebb8326111d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:55.831711 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07cd7bc-62de-4294-8a82-ebb8326111d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4df94390-c07e-496c-808c-3bf9f89a377c', 'volume_name': 'volume-4df94390-c07e-496c-808c-3bf9f89a377c', 'volume_size': 1, 'source_volid': 'faced0bd-b2a4-49f7-b940-74b6601b67ec', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:55.834098 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18d11d8-c54d-4642-80f5-77dd768ae37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:55.836370 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18d11d8-c54d-4642-80f5-77dd768ae37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:31:55.838584 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7283ab0-0312-4921-afce-31e09052ffd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:31:55.839341 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Volume 4df94390-c07e-496c-808c-3bf9f89a377c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4df94390-c07e-496c-808c-3bf9f89a377c', 'volume_size': 1, 'source_volid': 'faced0bd-b2a4-49f7-b940-74b6601b67ec', 'source_volstatus': 'available'} Nov 13 21:31:55.851707 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:31:56.026177 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] creating snapshot='volume-4df94390-c07e-496c-808c-3bf9f89a377c.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:31:59.417972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] cloning 'volume-faced0bd-b2a4-49f7-b940-74b6601b67ec@volume-4df94390-c07e-496c-808c-3bf9f89a377c.clone_snap' to 'volume-4df94390-c07e-496c-808c-3bf9f89a377c' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:32:01.689038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Volume volume-faced0bd-b2a4-49f7-b940-74b6601b67ec is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:01.690810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:32:01.691280 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:32:02.522020 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:32:02.525260 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7283ab0-0312-4921-afce-31e09052ffd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df94390-c07e-496c-808c-3bf9f89a377c', 'volume_size': 1, 'source_volid': 'faced0bd-b2a4-49f7-b940-74b6601b67ec', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:02.527983 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204f0c6d-46b8-4db8-97de-e905c3ba80ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:02.623852 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Volume volume-4df94390-c07e-496c-808c-3bf9f89a377c (4df94390-c07e-496c-808c-3bf9f89a377c): created successfully Nov 13 21:32:02.626124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204f0c6d-46b8-4db8-97de-e905c3ba80ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:02.629234 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (4c464fac-8827-4eff-aa71-a75376f5ae38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:02.732066 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e6a0ff98-6e89-403e-8654-e7178d83644f tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:32:04.116145 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:32:04.120963 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:32:04.121411 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:32:04.133945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (56237aba-c62a-414f-bd38-3a4a6e3dadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:04.137064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5899b61d-8ac5-4f5e-b124-06975d6475aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:04.147623 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:32:04.160408 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5899b61d-8ac5-4f5e-b124-06975d6475aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:32:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1159051446',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c567a74-c383-4da8-b3a6-32c5094de293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:32:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:32:04Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:04.163017 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb5aeb7-769b-4f06-bb4d-230373f74c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:04.165288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb5aeb7-769b-4f06-bb4d-230373f74c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:04.167629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b642e6-0cde-4f75-8c40-447a96bad35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:04.169856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b642e6-0cde-4f75-8c40-447a96bad35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c567a74-c383-4da8-b3a6-32c5094de293', 'volume_name': 'volume-5c567a74-c383-4da8-b3a6-32c5094de293', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:04.172596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa2d372-5de5-4d39-bab9-25520f501f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:04.174262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa2d372-5de5-4d39-bab9-25520f501f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:04.176438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c47d2d7-544e-40e4-a043-36e6fda2d4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:04.177239 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Volume 5c567a74-c383-4da8-b3a6-32c5094de293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c567a74-c383-4da8-b3a6-32c5094de293', 'volume_size': 1} Nov 13 21:32:04.177633 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] creating volume 'volume-5c567a74-c383-4da8-b3a6-32c5094de293' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:32:04.178610 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:05.421539 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:32:05.427028 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:32:05.427028 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c47d2d7-544e-40e4-a043-36e6fda2d4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c567a74-c383-4da8-b3a6-32c5094de293', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:05.427028 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f5020-5634-4475-b024-4e6687c28519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:05.501542 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Volume volume-5c567a74-c383-4da8-b3a6-32c5094de293 (5c567a74-c383-4da8-b3a6-32c5094de293): created successfully Nov 13 21:32:05.504233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f5020-5634-4475-b024-4e6687c28519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:05.508072 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (56237aba-c62a-414f-bd38-3a4a6e3dadb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:05.588039 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a68e3d5a-7398-4ff8-bd9b-c78f20e25f0a tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:32:06.258896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-5c567a74-c383-4da8-b3a6-32c5094de293-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:06.359870 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:06.643947 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:32:06.645310 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Volume volume-5c567a74-c383-4da8-b3a6-32c5094de293 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:06.907317 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-5c567a74-c383-4da8-b3a6-32c5094de293 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:07.263269 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-f3e95b9a-c4bb-4361-967e-b96869e60543-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:07.363879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:10.969184 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-f3e95b9a-c4bb-4361-967e-b96869e60543 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:11.873811 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] deleting rbd volume volume-f3e95b9a-c4bb-4361-967e-b96869e60543 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:15.007310 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Created reservations ['80430a96-0d64-48ff-9e42-82b84d76d1af', 'b0a78833-25ca-4f46-aad0-3f125b3b8816', '2bb33c22-9a18-42a7-96ac-e67489c390ba', 'e9f72b1f-312e-4b15-9dd0-f1b32e47b35f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:15.267716 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:15.373839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:15.426446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:15.428529 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:32:15.530448 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f68ab7f-238f-43b0-b867-5b282690c034 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-5c567a74-c383-4da8-b3a6-32c5094de293-delete_volume'" released by "delete_volume" :: held 9.271s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:16.088150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-4df94390-c07e-496c-808c-3bf9f89a377c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:16.235943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:16.598853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:32:17.122358 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-4df94390-c07e-496c-808c-3bf9f89a377c {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:18.176788 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:32:18.177520 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:18.198376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:18.223573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:20.262403 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Created reservations ['a7f8368b-ab78-4dec-9669-54634b9e330e', 'dd297c02-37bf-4874-a429-46c74d7bc383', '1488b916-c6ca-403d-b90f-1089c4e180e3', '2d0af2cc-4847-41ba-a82d-0fd984f2d870'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:20.487732 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:20.523318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:20.554799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:20.559311 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Deleted volume successfully. Nov 13 21:32:20.657195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-93cd6551-90a1-4b4f-9c8a-ef5539b286d7 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-f3e95b9a-c4bb-4361-967e-b96869e60543-delete_volume'" released by "delete_volume" :: held 13.394s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:21.194509 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-7309cb3a-c938-400f-9ae4-c05d4eacaafc-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:21.305644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:24.421440 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Volume volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:25.143988 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] deleting rbd volume volume-7309cb3a-c938-400f-9ae4-c05d4eacaafc {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:25.147579 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:32:25.412646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Volume volume-faced0bd-b2a4-49f7-b940-74b6601b67ec is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:25.413273 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] deleting parent snapshot volume-4df94390-c07e-496c-808c-3bf9f89a377c.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:32:29.496269 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Created reservations ['13128ce4-3e14-47dc-9880-7b4a1ceca4b1', '8be4afc3-a4d8-4258-8b80-4d7cd0a9f6c5', 'be991d12-82be-4fa7-915f-0642ed247a34', 'f28cc1e4-0ce1-4c50-bd5e-a0af9c7e12b7'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:29.704943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:29.735756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:29.793087 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:29.793087 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:32:29.884879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1baeafe8-21b0-4ddd-b38c-4b215666f101 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-4df94390-c07e-496c-808c-3bf9f89a377c-delete_volume'" released by "delete_volume" :: held 13.793s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:30.876023 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:32:30.879946 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:32:30.880390 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:32:30.892660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (68f45b93-7ff5-4301-9cd0-c77d085bd9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:30.897630 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4044b80-1fa4-4595-9711-ce1bf8935466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:30.904568 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:32:30.918687 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4044b80-1fa4-4595-9711-ce1bf8935466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2063862338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=538b57d3-65fb-449a-ab4b-121ae9593921,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:32:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:32:31Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:30.921415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689b0c80-6399-41b1-8eff-a8ef3653dbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:30.924392 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689b0c80-6399-41b1-8eff-a8ef3653dbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:30.927026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383eeda-647f-498e-8f46-bd92ed177d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:31.023294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f383eeda-647f-498e-8f46-bd92ed177d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '538b57d3-65fb-449a-ab4b-121ae9593921', 'volume_name': 'volume-538b57d3-65fb-449a-ab4b-121ae9593921', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:31.026979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049be523-77f5-4ebf-b90b-f4ae4fa052f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:31.029328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049be523-77f5-4ebf-b90b-f4ae4fa052f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:31.031667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92381fb-7b50-4200-b4d6-b4d171dba28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:31.033200 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Volume 538b57d3-65fb-449a-ab4b-121ae9593921: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-538b57d3-65fb-449a-ab4b-121ae9593921', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:32:31.033975 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Cloning 538b57d3-65fb-449a-ab4b-121ae9593921 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:32:31.044821 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:31.118798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 32, 31, 58244)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:32:31.119225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:32:31.119620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:32:31.125299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.081s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:31.126302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:32:31.133851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 32, 31, 130124)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:32:31.135211 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:32:31.135211 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:32:31.147693 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:31.503260 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] creating snapshot='volume-538b57d3-65fb-449a-ab4b-121ae9593921.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:32:33.401318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-538b57d3-65fb-449a-ab4b-121ae9593921.clone_snap' to 'volume-538b57d3-65fb-449a-ab4b-121ae9593921' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:32:33.502135 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Created reservations ['08c5ba9d-1cd4-4bfb-8279-2f0d63386dae', '949b3f9c-9bc4-4579-9ef1-cdaea6ed8c8d', 'eda7d3d4-82f1-4b21-a7cd-00d5ce9f62b7', 'cfa258c5-2557-4aa3-8b73-3f2103df5941'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:33.772962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:33.794946 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:33.820453 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:33.830117 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Deleted volume successfully. Nov 13 21:32:33.916625 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8267dd1d-a60f-4dc0-aa8b-3ba6ac755ed4 tempest-VolumesBackupsAdminTest-1301942349 None] Lock "b'cinder-7309cb3a-c938-400f-9ae4-c05d4eacaafc-delete_volume'" released by "delete_volume" :: held 12.718s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:35.638796 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:35.640274 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:32:35.640647 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:32:36.557803 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:32:36.563121 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Marking volume 538b57d3-65fb-449a-ab4b-121ae9593921 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:32:36.658479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 538b57d3-65fb-449a-ab4b-121ae9593921. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:32:36.658479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Creating volume glance metadata for volume 538b57d3-65fb-449a-ab4b-121ae9593921 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:32:36.830172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d92381fb-7b50-4200-b4d6-b4d171dba28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538b57d3-65fb-449a-ab4b-121ae9593921', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:36.832395 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d845764-3656-4afd-873b-0ba7937ce2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:36.904027 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Volume volume-538b57d3-65fb-449a-ab4b-121ae9593921 (538b57d3-65fb-449a-ab4b-121ae9593921): created successfully Nov 13 21:32:36.906079 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d845764-3656-4afd-873b-0ba7937ce2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:36.909015 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (68f45b93-7ff5-4301-9cd0-c77d085bd9ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:36.972679 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b8a90d68-648f-467d-8bfd-fa4329be0ddc tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:32:37.983350 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:32:37.986751 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:32:37.987200 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:32:37.999974 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Flow 'volume_create_manager' (534673e4-d7c4-4b71-9b7d-561f1ce3dfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:38.004739 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca260c-916f-42a0-9da7-26348e77d226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:38.009616 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:32:38.024043 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dca260c-916f-42a0-9da7-26348e77d226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-369414277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2299b43e-ccec-4910-ba73-64bdb8fe0c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76b899a098c48d5a62addf3d38e3944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:32:38Z,use_quota=True,user_id='93aac613085b49849380d5be8427ff40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:38.026576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdfe434-5e68-4abd-8806-b973442e7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:38.028714 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fdfe434-5e68-4abd-8806-b973442e7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:38.033484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6f46f-f10d-4e7f-afda-91042c6b2d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:38.033484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95e6f46f-f10d-4e7f-afda-91042c6b2d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2299b43e-ccec-4910-ba73-64bdb8fe0c78', 'volume_name': 'volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:38.035516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a29446-bdfc-4238-92b8-5d83cb983517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:38.037645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a29446-bdfc-4238-92b8-5d83cb983517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:38.040262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a8c53-610d-4024-91a7-640c1423b796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:38.041044 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Volume 2299b43e-ccec-4910-ba73-64bdb8fe0c78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78', 'volume_size': 1} Nov 13 21:32:38.041431 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] creating volume 'volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:32:38.042390 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:39.080192 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:32:39.083410 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:32:39.083854 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:32:39.096033 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (0ad2cace-160b-4f64-8fe1-b1e04282f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:39.099062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08df29da-a720-4a24-9e4b-a6fa5c26d718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.105426 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:32:39.119818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08df29da-a720-4a24-9e4b-a6fa5c26d718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:32:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2021017764',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0751215c-2801-4ecb-ae4c-822651a69a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef8ae5f0ac9c43f29ee3a8696e857409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:32:39Z,use_quota=True,user_id='6a53540e319f43c0ab5bddb5ad474c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.123593 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cec8f19-af61-4e1f-956b-c0f2b0ee5eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.125722 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cec8f19-af61-4e1f-956b-c0f2b0ee5eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.128488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20eabc1-c0f4-4a15-9796-4a0993fb6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.130670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20eabc1-c0f4-4a15-9796-4a0993fb6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0751215c-2801-4ecb-ae4c-822651a69a1d', 'volume_name': 'volume-0751215c-2801-4ecb-ae4c-822651a69a1d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.133127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cf3281-c10b-4e34-9336-46d0bae8bd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.135875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cf3281-c10b-4e34-9336-46d0bae8bd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.138848 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a906a4-62ee-43a2-bcd5-f1f5871678a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.139636 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Volume 0751215c-2801-4ecb-ae4c-822651a69a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0751215c-2801-4ecb-ae4c-822651a69a1d', 'volume_size': 1} Nov 13 21:32:39.140025 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] creating volume 'volume-0751215c-2801-4ecb-ae4c-822651a69a1d' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:32:39.141057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:39.249759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:32:39.250148 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:32:39.252175 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5a8c53-610d-4024-91a7-640c1423b796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.254445 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bb187a-43fd-4927-84de-1f0286619007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:39.321064 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Volume volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78 (2299b43e-ccec-4910-ba73-64bdb8fe0c78): created successfully Nov 13 21:32:39.324948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6bb187a-43fd-4927-84de-1f0286619007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:39.325990 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Flow 'volume_create_manager' (534673e4-d7c4-4b71-9b7d-561f1ce3dfe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:39.439351 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e0f31856-9981-4d62-9913-18702b8eb157 tempest-SnapshotMetadataTestJSON-1613611636 None] Created volume successfully. Nov 13 21:32:40.141062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:32:40.141729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:32:40.143492 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23a906a4-62ee-43a2-bcd5-f1f5871678a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0751215c-2801-4ecb-ae4c-822651a69a1d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:40.145778 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b364611-f577-40ec-8e05-1da81f94ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:32:40.236798 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Volume volume-0751215c-2801-4ecb-ae4c-822651a69a1d (0751215c-2801-4ecb-ae4c-822651a69a1d): created successfully Nov 13 21:32:40.239242 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b364611-f577-40ec-8e05-1da81f94ce97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:32:40.244330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Flow 'volume_create_manager' (0ad2cace-160b-4f64-8fe1-b1e04282f94b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:32:40.324717 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d1466e64-c0e6-4c53-86c8-9741359567aa tempest-VolumesGetTest-651263124 None] Created volume successfully. Nov 13 21:32:40.624553 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cd60497f-b5fa-4041-936d-169038f9a035 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:41.218948 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Lock "b'cinder-0751215c-2801-4ecb-ae4c-822651a69a1d-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:41.342292 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:41.486426 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:32:41.487074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Volume volume-0751215c-2801-4ecb-ae4c-822651a69a1d is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:41.733064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-0751215c-2801-4ecb-ae4c-822651a69a1d {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:44.566672 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cd60497f-b5fa-4041-936d-169038f9a035 tempest-SnapshotMetadataTestJSON-1613611636 None] Create snapshot completed successfully Nov 13 21:32:47.017659 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-86df09ad-cc2f-4e2f-8bf4-dc7ce55bb104 tempest-SnapshotMetadataTestJSON-1613611636 None] Lock "b'cinder-50ba1cca-f332-4710-ac40-63cf48c9ef20-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:47.019041 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-86df09ad-cc2f-4e2f-8bf4-dc7ce55bb104 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:49.538115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Created reservations ['cde8ad2c-b7f2-4df2-a637-c6fb3daed3c2', 'b431210f-957a-45f6-a9ad-8e6d206b4450', '36b3c865-f98a-456d-a26f-a754049864a4', '45f01b80-2413-4402-af76-def12b10cf7e'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:49.813144 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:49.863795 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:49.894355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:32:49.899077 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:32:50.046314 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-78c5edb5-110f-4ae0-b177-c965d0b0ad8b tempest-VolumesGetTest-651263124 None] Lock "b'cinder-0751215c-2801-4ecb-ae4c-822651a69a1d-delete_volume'" released by "delete_volume" :: held 8.827s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:50.962527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] Lock "b'cinder-538b57d3-65fb-449a-ab4b-121ae9593921-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:51.125428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:51.599143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:32:51.831442 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-538b57d3-65fb-449a-ab4b-121ae9593921 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:32:52.132918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-86df09ad-cc2f-4e2f-8bf4-dc7ce55bb104 tempest-SnapshotMetadataTestJSON-1613611636 None] Created reservations ['a294dd42-f865-430a-b2e9-cf1d3e75ba4b', 'aa054715-88e5-4f9e-a9be-f1d5e2f2c80e', '2c704e16-0d88-4afe-a421-8cfe4d1ea2d5', '9fdda5c3-c0e9-4547-aa14-50486779f9a9'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:32:52.365125 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-86df09ad-cc2f-4e2f-8bf4-dc7ce55bb104 tempest-SnapshotMetadataTestJSON-1613611636 None] Delete snapshot completed successfully. Nov 13 21:32:52.371373 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-86df09ad-cc2f-4e2f-8bf4-dc7ce55bb104 tempest-SnapshotMetadataTestJSON-1613611636 None] Lock "b'cinder-50ba1cca-f332-4710-ac40-63cf48c9ef20-delete_snapshot'" released by "delete_snapshot" :: held 5.354s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:32:53.387584 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Lock "b'cinder-2299b43e-ccec-4910-ba73-64bdb8fe0c78-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:32:53.532170 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:32:53.730762 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:32:53.731267 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Volume volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:32:54.185179 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] deleting rbd volume volume-2299b43e-ccec-4910-ba73-64bdb8fe0c78 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:00.234495 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:33:00.442353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] deleting parent snapshot volume-538b57d3-65fb-449a-ab4b-121ae9593921.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:33:04.521590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] Created reservations ['b63a38a8-cef7-4774-b7b5-a4831ec28850', '93c38854-95b0-47b0-b69d-98a42e590617', 'a240cf9a-cecf-4b21-a0e0-a52b6f852dac', '41ffa688-41b7-4235-a9b2-12910b1cbe75'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:04.543998 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Created reservations ['1316eb46-4a18-4a77-9853-a112f531a67d', 'aeaff556-8776-4402-8d2f-1ce859269ef6', '35ce141d-1598-4be0-93f8-2ef24d6a180c', 'a6c31296-edc5-4df3-9cff-e57041b581df'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:04.787427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:04.816093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:04.840325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:04.845979 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:33:04.906005 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-faced0bd-b2a4-49f7-b940-74b6601b67ec-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:04.922038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:04.953825 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:04.985018 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:04.992860 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9c7fd613-e653-4e5e-8e1a-b508e6c1845e tempest-VolumesGetTest-651263124 None] Lock "b'cinder-538b57d3-65fb-449a-ab4b-121ae9593921-delete_volume'" released by "delete_volume" :: held 14.034s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:04.994176 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Deleted volume successfully. Nov 13 21:33:05.011855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:05.149437 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:05.149854 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Volume volume-faced0bd-b2a4-49f7-b940-74b6601b67ec is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:05.428943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] deleting rbd volume volume-faced0bd-b2a4-49f7-b940-74b6601b67ec {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:05.443129 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6e34997b-aaf1-48bf-9779-32b45a00ae66 tempest-SnapshotMetadataTestJSON-1613611636 None] Lock "b'cinder-2299b43e-ccec-4910-ba73-64bdb8fe0c78-delete_volume'" released by "delete_volume" :: held 12.057s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:08.928534 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:08.932128 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:08.932568 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:08.944494 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (1444c429-4bb3-4209-8744-299da21a6b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:08.947549 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0661ac-9c58-4834-8513-77bfa8e1471c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:08.953606 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:08.966408 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0661ac-9c58-4834-8513-77bfa8e1471c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1113862100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=93cbe274-4d0a-4195-b7e7-0a02eeb0b407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca896180bd14166b581f7c307622554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:09Z,use_quota=True,user_id='fd17d86cfc744091b8d1a56086ded771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:08.968903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ae329e-88aa-40c9-bae3-c16245611b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:08.970959 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ae329e-88aa-40c9-bae3-c16245611b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:08.973294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195cac29-fd78-4482-9817-c4e206119425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:08.975429 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (195cac29-fd78-4482-9817-c4e206119425) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'volume_name': 'volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:08.977726 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc979e71-eb68-4931-84ed-8d62d9671ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:08.979757 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc979e71-eb68-4931-84ed-8d62d9671ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:08.982441 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb17c1f-6340-43dd-b4b6-a22cfa2dfabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:08.983200 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Volume 93cbe274-4d0a-4195-b7e7-0a02eeb0b407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'volume_size': 1} Nov 13 21:33:08.983594 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] creating volume 'volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:33:08.984550 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:09.682826 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:09.686051 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:09.686494 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:09.700761 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Flow 'volume_create_manager' (7d8d8325-0ffe-4fe0-88f9-8bc2546c53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:09.703786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d664de1-aa55-4c41-a9e2-bdd8cc79ae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:09.709796 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:09.723091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d664de1-aa55-4c41-a9e2-bdd8cc79ae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-183419456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=38654d28-5ae6-4c32-968d-fd277d48e0ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766ca801b9ff41e58e3ebe11c16c0855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:10Z,use_quota=True,user_id='35075ae48c324cbb8edca85f0f36b355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:09.725617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc41acb1-c24a-40c3-bc07-2053eb9e07d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:09.727776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc41acb1-c24a-40c3-bc07-2053eb9e07d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:09.731443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d568ca-7935-416a-8f2c-209773ef7f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:09.732824 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91d568ca-7935-416a-8f2c-209773ef7f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38654d28-5ae6-4c32-968d-fd277d48e0ed', 'volume_name': 'volume-38654d28-5ae6-4c32-968d-fd277d48e0ed', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:09.735056 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbff065-7969-440f-a710-78dd82c21a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:09.737130 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbff065-7969-440f-a710-78dd82c21a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:09.739262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fc0818-524a-4b61-91df-df4313f97717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:09.740024 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Volume 38654d28-5ae6-4c32-968d-fd277d48e0ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38654d28-5ae6-4c32-968d-fd277d48e0ed', 'volume_size': 1} Nov 13 21:33:09.740420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] creating volume 'volume-38654d28-5ae6-4c32-968d-fd277d48e0ed' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:33:09.741421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:10.088105 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:10.088794 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:10.090438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb17c1f-6340-43dd-b4b6-a22cfa2dfabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:10.092528 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843459c1-213f-4303-8a76-7947c946f029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:10.245112 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407 (93cbe274-4d0a-4195-b7e7-0a02eeb0b407): created successfully Nov 13 21:33:10.247603 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843459c1-213f-4303-8a76-7947c946f029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:10.250700 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (1444c429-4bb3-4209-8744-299da21a6b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:10.361257 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-25eb364f-d28c-4e57-92e0-1d784739d750 tempest-AttachVolumeNegativeTest-2135233649 None] Created volume successfully. Nov 13 21:33:10.828999 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:10.829929 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:10.831859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1fc0818-524a-4b61-91df-df4313f97717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38654d28-5ae6-4c32-968d-fd277d48e0ed', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:10.834779 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd2dd4c-e4fd-4cae-8d94-dc39f0a07365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:10.950267 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Volume volume-38654d28-5ae6-4c32-968d-fd277d48e0ed (38654d28-5ae6-4c32-968d-fd277d48e0ed): created successfully Nov 13 21:33:10.952150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcd2dd4c-e4fd-4cae-8d94-dc39f0a07365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:10.955034 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Flow 'volume_create_manager' (7d8d8325-0ffe-4fe0-88f9-8bc2546c53e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:11.046813 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-c760c2ac-c3cc-48be-aac9-058b9b9ab70b tempest-VolumesTransfersTest-2053616099 None] Created volume successfully. Nov 13 21:33:11.759271 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-e10aea8d-c5e7-4c61-95aa-e49c28e40919 req-c4d669ce-c6b9-4092-a3e3-fccaff235ae9 tempest-AttachVolumeNegativeTest-2135233649 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:33:12.404282 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-e10aea8d-c5e7-4c61-95aa-e49c28e40919 req-c4d669ce-c6b9-4092-a3e3-fccaff235ae9 tempest-AttachVolumeNegativeTest-2135233649 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.645s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:33:12.405029 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-e10aea8d-c5e7-4c61-95aa-e49c28e40919 req-c4d669ce-c6b9-4092-a3e3-fccaff235ae9 tempest-AttachVolumeNegativeTest-2135233649 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:33:12.554030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-e10aea8d-c5e7-4c61-95aa-e49c28e40919 req-c4d669ce-c6b9-4092-a3e3-fccaff235ae9 tempest-AttachVolumeNegativeTest-2135233649 None] Connection info returned from driver {'name': 'volumes/volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '93cbe274-4d0a-4195-b7e7-0a02eeb0b407', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '74c571d7-be3f-471f-8fe1-daf299caf269'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:33:12.673783 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-e10aea8d-c5e7-4c61-95aa-e49c28e40919 req-c4d669ce-c6b9-4092-a3e3-fccaff235ae9 tempest-AttachVolumeNegativeTest-2135233649 None] attachment_update completed successfully. Nov 13 21:33:12.779318 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bb5b735c-6d6c-4097-ba24-c488d26fb893 tempest-VolumesTransfersTest-1097457527 None] Transfer volume completed successfully. Nov 13 21:33:13.562055 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Created reservations ['378e6990-2a1f-42d9-8923-ce705fe9dbd7', '026f0bcb-2874-43b8-965d-2fd6f57f703d', '964482be-71dc-45d5-9394-2f71debdf401', 'b1c59786-0645-40b8-8ad0-f9ce385b4952'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:13.727477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Lock "b'cinder-38654d28-5ae6-4c32-968d-fd277d48e0ed-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:13.743641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:13.775598 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:13.801600 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:13.810513 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Deleted volume successfully. Nov 13 21:33:13.823199 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:14.208578 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:14.208955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Volume volume-38654d28-5ae6-4c32-968d-fd277d48e0ed is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:14.419086 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] deleting rbd volume volume-38654d28-5ae6-4c32-968d-fd277d48e0ed {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:14.427282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-22046a48-edf5-4dd2-80fa-2584c3bdd527 tempest-VolumesGetTest-651263124 None] Lock "b'cinder-faced0bd-b2a4-49f7-b940-74b6601b67ec-delete_volume'" released by "delete_volume" :: held 9.521s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:18.179475 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:33:18.180200 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:18.229304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:18.274771 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:21.292860 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Created reservations ['f72ad93f-46ab-4d3e-b4f4-cf2f7935033a', 'd63dacd3-1a5f-4648-be14-30678ea8bf48', 'dc86f01c-3e4d-423c-a1de-15e4fd5ce494', '4500a048-2fc3-4e2e-a448-2c2a56256c1a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:21.499802 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:21.621833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:21.690867 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:21.695129 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Deleted volume successfully. Nov 13 21:33:21.772527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7f94f616-f173-4f55-b625-956e0b1e110e tempest-VolumesTransfersTest-1646322993 None] Lock "b'cinder-38654d28-5ae6-4c32-968d-fd277d48e0ed-delete_volume'" released by "delete_volume" :: held 8.044s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:23.413577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:23.419645 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:23.419645 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:23.434349 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Flow 'volume_create_manager' (de5f211b-f509-4c25-814b-d36e78a2e845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:23.437934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4b6c20-a29c-4640-ad28-9c3e2bee2325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:23.463199 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:23.483587 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4b6c20-a29c-4640-ad28-9c3e2bee2325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-743220238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a479df12-c1a5-48f0-a62b-cf5da1196dbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='766ca801b9ff41e58e3ebe11c16c0855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:23Z,use_quota=True,user_id='35075ae48c324cbb8edca85f0f36b355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:23.488041 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af44d6c9-87ef-4dd3-a247-30a226aeb49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:23.490381 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af44d6c9-87ef-4dd3-a247-30a226aeb49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:23.493033 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984644a-9e52-4f95-a880-41e594c4790f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:23.495438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6984644a-9e52-4f95-a880-41e594c4790f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a479df12-c1a5-48f0-a62b-cf5da1196dbc', 'volume_name': 'volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:23.499453 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5b4820-9c60-4059-baa4-bb91fb4bba54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:23.501810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e5b4820-9c60-4059-baa4-bb91fb4bba54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:23.504210 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f913a57d-abed-4b5e-9f48-658818653e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:23.505232 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Volume a479df12-c1a5-48f0-a62b-cf5da1196dbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc', 'volume_size': 1} Nov 13 21:33:23.505810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] creating volume 'volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:33:23.506992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:24.172080 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:24.172237 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:24.174312 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f913a57d-abed-4b5e-9f48-658818653e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:24.176637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b9682c-a7c5-4255-b9fd-b9d9261047f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:24.248017 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Volume volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc (a479df12-c1a5-48f0-a62b-cf5da1196dbc): created successfully Nov 13 21:33:24.250517 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b9682c-a7c5-4255-b9fd-b9d9261047f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:24.255132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Flow 'volume_create_manager' (de5f211b-f509-4c25-814b-d36e78a2e845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:24.339422 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e25a39c3-dede-405c-964d-be8fbad232b0 tempest-VolumesTransfersTest-2053616099 None] Created volume successfully. Nov 13 21:33:26.257338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Lock "b'cinder-a479df12-c1a5-48f0-a62b-cf5da1196dbc-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:26.357026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:26.562985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:26.563740 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Volume volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:26.688821 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] deleting rbd volume volume-a479df12-c1a5-48f0-a62b-cf5da1196dbc {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:28.003495 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-33cb697b-f1b8-4f64-8a20-a063c86023df tempest-TaggedBootDevicesTest-27436268 None] Terminate volume connection completed successfully. Nov 13 21:33:28.003495 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-33cb697b-f1b8-4f64-8a20-a063c86023df tempest-TaggedBootDevicesTest-27436268 None] Deleting attachment 8baa784d-db3e-4e2a-9a7b-beda83dd5b7a. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:33:28.211266 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-4833b816-6de7-4f01-add6-18284806ac91 tempest-TaggedBootDevicesTest-27436268 None] Terminate volume connection completed successfully. Nov 13 21:33:28.212138 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-4833b816-6de7-4f01-add6-18284806ac91 tempest-TaggedBootDevicesTest-27436268 None] Deleting attachment ff7f13ec-1dee-4fea-9261-83e23d790a85. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:33:28.518011 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-301396e8-7648-4307-ba91-b4a3adea9d0d tempest-TaggedBootDevicesTest-27436268 None] Terminate volume connection completed successfully. Nov 13 21:33:28.524098 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-4730c3d5-be61-4438-98f1-4b536cde9155 req-301396e8-7648-4307-ba91-b4a3adea9d0d tempest-TaggedBootDevicesTest-27436268 None] Deleting attachment a719a7db-411a-4f03-a2ff-32e87e26584d. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:33:30.664722 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Created reservations ['f7d7bbb1-84dd-441a-97f1-27765c56f46a', '6127f6a8-5cec-4878-9924-1e696f306863', 'bae8ea46-d0d9-4f45-a2fd-7c4b064f18df', '5a798f2f-ebbf-481a-a03c-c9d61cbebd53'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:30.846455 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:30.883558 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:30.941979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:30.954348 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Deleted volume successfully. Nov 13 21:33:31.089563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-44413f3e-013f-4a2b-97c6-a679fb1c5d5e tempest-VolumesTransfersTest-1646322993 None] Lock "b'cinder-a479df12-c1a5-48f0-a62b-cf5da1196dbc-delete_volume'" released by "delete_volume" :: held 4.828s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:32.197099 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-08134dc2-92e8-47dc-bf8c-b86e1f1d11e4 req-8be18162-c5d6-431d-b03a-6259d6b730ee tempest-AttachVolumeNegativeTest-2135233649 None] Terminate volume connection completed successfully. Nov 13 21:33:32.197781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-08134dc2-92e8-47dc-bf8c-b86e1f1d11e4 req-8be18162-c5d6-431d-b03a-6259d6b730ee tempest-AttachVolumeNegativeTest-2135233649 None] Deleting attachment 74c571d7-be3f-471f-8fe1-daf299caf269. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:33:36.857843 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-7e0c5987-8761-4183-9e0a-6f77ec67421c-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:37.030531 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:37.213150 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:37.214575 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-7e0c5987-8761-4183-9e0a-6f77ec67421c is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:37.416055 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] deleting rbd volume volume-7e0c5987-8761-4183-9e0a-6f77ec67421c {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:40.438606 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:40.455554 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:40.456241 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:40.471385 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (d24c8561-83a5-4cef-8609-b55fe38f9bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:40.476022 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6fd590-decc-4313-909e-b23f709bd9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:40.483949 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:40.503933 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f6fd590-decc-4313-909e-b23f709bd9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1247813623',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc7e43ff-2fd0-436b-8fed-1a164630fe09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4297148128fa4413bd58494913cbadbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:40Z,use_quota=True,user_id='62ed5a7a6b3945c1a3f9e0537ac7967e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:40.508573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01446f73-ae10-4a9b-8529-56fafbd55a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:40.511353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01446f73-ae10-4a9b-8529-56fafbd55a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:40.515164 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a761f-1a61-4d64-8150-778b1c6dfb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:40.642996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161a761f-1a61-4d64-8150-778b1c6dfb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'volume_name': 'volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:40.645863 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e8526f-c22a-4b45-8ce8-949ed05498ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:40.648719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e8526f-c22a-4b45-8ce8-949ed05498ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:40.651194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68785c2e-f0b7-45ec-b8ef-1d4ba8df52a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:40.652411 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Volume dc7e43ff-2fd0-436b-8fed-1a164630fe09: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:33:40.653835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Cloning dc7e43ff-2fd0-436b-8fed-1a164630fe09 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:33:40.665500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:40.755491 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 33, 40, 670061)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:33:40.756168 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:33:40.756706 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:33:40.762841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.097s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:40.764957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:33:40.771823 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 33, 40, 768987)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:33:40.772323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:33:40.772860 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:33:40.789271 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:41.127095 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] creating snapshot='volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:33:43.060188 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09.clone_snap' to 'volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:33:43.179191 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Created reservations ['35797e18-91da-4671-8276-19df6428d04b', '5812de15-61d7-4799-a2d5-e69db419684c', '674e1b43-97a2-4a18-86ef-959d75d5e163', 'ef0b5c6f-5d35-450d-aa27-72a9741ec434'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:43.396814 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:43.436957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:43.471136 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:43.475271 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Deleted volume successfully. Nov 13 21:33:43.599719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e556621c-0594-47b8-9f3f-eae225018a94 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-7e0c5987-8761-4183-9e0a-6f77ec67421c-delete_volume'" released by "delete_volume" :: held 6.737s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:44.218026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:44.220257 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:44.220630 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:44.767433 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:33:44.768643 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Marking volume dc7e43ff-2fd0-436b-8fed-1a164630fe09 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:33:44.789545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-0f98d81c-d5c9-402b-b67f-dbc7db1d161a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:44.853844 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to dc7e43ff-2fd0-436b-8fed-1a164630fe09. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:33:44.854273 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Creating volume glance metadata for volume dc7e43ff-2fd0-436b-8fed-1a164630fe09 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:33:44.916308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:45.041664 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:45.042149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Volume volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:45.172202 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] deleting rbd volume volume-0f98d81c-d5c9-402b-b67f-dbc7db1d161a {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:45.176358 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68785c2e-f0b7-45ec-b8ef-1d4ba8df52a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:45.178607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238161de-1d53-4629-bc9a-6cac448706c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:45.331788 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Volume volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09 (dc7e43ff-2fd0-436b-8fed-1a164630fe09): created successfully Nov 13 21:33:45.334477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238161de-1d53-4629-bc9a-6cac448706c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:45.337419 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (d24c8561-83a5-4cef-8609-b55fe38f9bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:45.459307 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0a512437-2909-40ba-a37f-7a0a96511a14 tempest-VolumesCloneTest-2027550173 None] Created volume successfully. Nov 13 21:33:46.666296 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:46.670442 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:46.670882 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:46.711229 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (b65f4e1c-ebfd-4b31-90ca-099c0101e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:46.715013 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d306f0-b17e-429e-bee4-ad853fb7237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:46.721483 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:46.734579 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d306f0-b17e-429e-bee4-ad853fb7237a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1211721368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24a53419-6b7e-4e6e-8a2c-972674b69ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4297148128fa4413bd58494913cbadbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dc7e43ff-2fd0-436b-8fed-1a164630fe09,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:46Z,use_quota=True,user_id='62ed5a7a6b3945c1a3f9e0537ac7967e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:46.737107 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24689622-988c-4eab-978e-03502c71247a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:46.739248 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24689622-988c-4eab-978e-03502c71247a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:46.741615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdc0c77-0526-4f7a-a54b-573b1836e16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:46.757495 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdc0c77-0526-4f7a-a54b-573b1836e16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '24a53419-6b7e-4e6e-8a2c-972674b69ac6', 'volume_name': 'volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6', 'volume_size': 1, 'source_volid': 'dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:46.759344 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4403912-a6cc-4102-a6ee-59fd5034a5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:46.761437 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4403912-a6cc-4102-a6ee-59fd5034a5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:46.763643 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81854cb6-e00d-4b85-a588-bad5a5bfd064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:46.764444 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Volume 24a53419-6b7e-4e6e-8a2c-972674b69ac6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6', 'volume_size': 1, 'source_volid': 'dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'source_volstatus': 'available'} Nov 13 21:33:46.776659 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:47.304537 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] creating snapshot='volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:33:50.075042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] cloning 'volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09@volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6.clone_snap' to 'volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:33:50.173196 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:50.176494 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:50.176980 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:50.188759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (9d23843e-5aaf-4566-8f54-ac8bfb93c89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:50.192064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c15c6bc-b63d-42b1-8152-e6e3b800ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:50.198693 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:50.210886 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c15c6bc-b63d-42b1-8152-e6e3b800ddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-997888343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=182cff1a-9ccd-4c85-860e-24293a524f7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca896180bd14166b581f7c307622554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:49Z,use_quota=True,user_id='fd17d86cfc744091b8d1a56086ded771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:50.213556 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ebc1e-1e30-48c4-98f4-ddae22bad386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:50.215684 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464ebc1e-1e30-48c4-98f4-ddae22bad386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:50.217989 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3fd01b-18bc-4255-9455-d90226adf90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:50.220136 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f3fd01b-18bc-4255-9455-d90226adf90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '182cff1a-9ccd-4c85-860e-24293a524f7d', 'volume_name': 'volume-182cff1a-9ccd-4c85-860e-24293a524f7d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:50.222410 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12c5e98-359f-47a8-8efb-26a603d5e9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:50.224414 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12c5e98-359f-47a8-8efb-26a603d5e9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:50.227198 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89289907-65cd-4d24-9eb0-a06b54bfa0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:50.227545 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Volume 182cff1a-9ccd-4c85-860e-24293a524f7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-182cff1a-9ccd-4c85-860e-24293a524f7d', 'volume_size': 1} Nov 13 21:33:50.227927 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] creating volume 'volume-182cff1a-9ccd-4c85-860e-24293a524f7d' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:33:50.228943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:51.737042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:51.737766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:51.740545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89289907-65cd-4d24-9eb0-a06b54bfa0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-182cff1a-9ccd-4c85-860e-24293a524f7d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:51.743377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782e2b4-ae0e-4d3c-9814-09eaa55b8492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:51.842408 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-182cff1a-9ccd-4c85-860e-24293a524f7d (182cff1a-9ccd-4c85-860e-24293a524f7d): created successfully Nov 13 21:33:51.844348 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8782e2b4-ae0e-4d3c-9814-09eaa55b8492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:51.847309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (9d23843e-5aaf-4566-8f54-ac8bfb93c89e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:51.939166 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-58c7869a-7ac5-4aa7-bae8-23a2284377e9 tempest-AttachVolumeNegativeTest-2135233649 None] Created volume successfully. Nov 13 21:33:52.007479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Created reservations ['07b200f3-16e6-43e8-a52e-8b6095033f7a', '30f12395-e6f7-42ca-a3fd-ac0694536fc2', '587cedb0-928a-42bd-9072-7b84e1c2e9ba', '25d235ea-cede-40bc-9f09-0ef5a328bbee'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:33:52.303963 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:52.340305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:52.370554 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:33:52.529303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:33:52.531143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:52.531609 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:53.173935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:33:53.174987 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Marking volume 24a53419-6b7e-4e6e-8a2c-972674b69ac6 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:33:53.198784 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Deleted volume successfully. Nov 13 21:33:53.348984 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Copying metadata from source volume dc7e43ff-2fd0-436b-8fed-1a164630fe09 to 24a53419-6b7e-4e6e-8a2c-972674b69ac6. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Nov 13 21:33:53.410311 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-4e0edf6c-d7c3-45cf-a0e6-e055751e3d82 tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-0f98d81c-d5c9-402b-b67f-dbc7db1d161a-delete_volume'" released by "delete_volume" :: held 8.621s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:33:53.524338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-d625332a-ae4e-48de-8f45-0bb6ba890ff5-delete_volume'" acquired by "delete_volume" :: waited 0.044s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:33:53.528338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81854cb6-e00d-4b85-a588-bad5a5bfd064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6', 'volume_size': 1, 'source_volid': 'dc7e43ff-2fd0-436b-8fed-1a164630fe09', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:53.536510 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba0ed33-efec-492c-9e2f-4cbbfca1395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:53.556729 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-87a6dae4-56f2-4fca-9972-267bba6cb03a req-88af007f-9458-4b0d-8876-2fd24b86ae67 tempest-AttachVolumeNegativeTest-2135233649 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:33:53.649289 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Volume volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6 (24a53419-6b7e-4e6e-8a2c-972674b69ac6): created successfully Nov 13 21:33:53.651924 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba0ed33-efec-492c-9e2f-4cbbfca1395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:53.657498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (b65f4e1c-ebfd-4b31-90ca-099c0101e144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:53.739561 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:53.948836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:33:54.065986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] deleting rbd volume volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:33:54.068349 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-c84b2627-6ff1-4567-b17d-f63158377558 tempest-VolumesCloneTest-2027550173 None] Created volume successfully. Nov 13 21:33:54.581812 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-87a6dae4-56f2-4fca-9972-267bba6cb03a req-88af007f-9458-4b0d-8876-2fd24b86ae67 tempest-AttachVolumeNegativeTest-2135233649 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.025s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:33:54.582501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-87a6dae4-56f2-4fca-9972-267bba6cb03a req-88af007f-9458-4b0d-8876-2fd24b86ae67 tempest-AttachVolumeNegativeTest-2135233649 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-182cff1a-9ccd-4c85-860e-24293a524f7d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '182cff1a-9ccd-4c85-860e-24293a524f7d', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:33:54.796985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-87a6dae4-56f2-4fca-9972-267bba6cb03a req-88af007f-9458-4b0d-8876-2fd24b86ae67 tempest-AttachVolumeNegativeTest-2135233649 None] Connection info returned from driver {'name': 'volumes/volume-182cff1a-9ccd-4c85-860e-24293a524f7d', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '182cff1a-9ccd-4c85-860e-24293a524f7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b73dcfee-50a5-40e0-8912-6dc482433c52'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:33:54.931737 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-87a6dae4-56f2-4fca-9972-267bba6cb03a req-88af007f-9458-4b0d-8876-2fd24b86ae67 tempest-AttachVolumeNegativeTest-2135233649 None] attachment_update completed successfully. Nov 13 21:33:55.095234 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:55.101663 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:55.102494 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:55.118705 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (a0d994c9-d414-48b9-bef8-cd47baf87ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:55.126428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceaa3c8-aeba-4095-8c62-3996fb8bdd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:55.135061 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:55.149931 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aceaa3c8-aeba-4095-8c62-3996fb8bdd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-383514618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4297148128fa4413bd58494913cbadbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:55Z,use_quota=True,user_id='62ed5a7a6b3945c1a3f9e0537ac7967e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:55.152559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e197665-dcce-4b09-89f1-f2f2f243a67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:55.156078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e197665-dcce-4b09-89f1-f2f2f243a67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:55.158841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860a7a03-7bc8-483b-8057-6d75f3336434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:55.161473 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (860a7a03-7bc8-483b-8057-6d75f3336434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'volume_name': 'volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:55.164009 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1d97d7-daf0-4c15-9a98-f3acfb7a2d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:55.174141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e1d97d7-daf0-4c15-9a98-f3acfb7a2d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:55.174141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705583cb-e228-42da-960f-7698f1818d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:55.174141 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Volume 8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'volume_size': 1} Nov 13 21:33:55.174141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] creating volume 'volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:33:55.174141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:56.685028 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:33:56.686303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:33:56.687541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705583cb-e228-42da-960f-7698f1818d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:56.689651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968bac98-6420-4ef6-986b-6aa918dfade9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:56.768977 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Volume volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751 (8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751): created successfully Nov 13 21:33:56.771168 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968bac98-6420-4ef6-986b-6aa918dfade9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:56.774967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (a0d994c9-d414-48b9-bef8-cd47baf87ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:56.830234 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d729f48c-3c12-4aa7-98a7-0f756c8f87dd tempest-VolumesCloneTest-2027550173 None] Created volume successfully. Nov 13 21:33:57.888748 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:33:57.892023 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:33:57.892367 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:33:57.913299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (944dac8a-0a51-47cb-9981-2aad360e92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:33:57.916922 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818cd3f1-8fd1-46cc-914d-a8fc509edb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:57.926830 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:33:57.937620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (818cd3f1-8fd1-46cc-914d-a8fc509edb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1863240604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c73593d0-2962-45ce-ab73-6bef0d7a3c78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4297148128fa4413bd58494913cbadbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:33:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751,status='creating',terminated_at=None,updated_at=2021-11-13T21:33:58Z,use_quota=True,user_id='62ed5a7a6b3945c1a3f9e0537ac7967e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:57.939736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcae8a33-dc4a-479f-b420-bef09469fc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:57.941950 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcae8a33-dc4a-479f-b420-bef09469fc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:57.944577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c8082-a25e-4e10-ac7e-ce31df6ce8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:57.958144 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f67c8082-a25e-4e10-ac7e-ce31df6ce8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c73593d0-2962-45ce-ab73-6bef0d7a3c78', 'volume_name': 'volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78', 'volume_size': 2, 'source_volid': '8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:57.960522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d0a0dc-d0a2-4b56-b30f-e1c1dc6b13b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:57.962735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d0a0dc-d0a2-4b56-b30f-e1c1dc6b13b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:33:57.968763 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d1c75e-7d7c-4e03-8fc2-2ee83b5b9e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:33:57.969344 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Volume c73593d0-2962-45ce-ab73-6bef0d7a3c78: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78', 'volume_size': 2, 'source_volid': '8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'source_volstatus': 'available'} Nov 13 21:33:57.981729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:33:58.293301 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] creating snapshot='volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:34:00.626224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] cloning 'volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751@volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78.clone_snap' to 'volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:34:00.641975 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-5c35a3b7-64d5-4565-9ffc-98a8255373fb req-3b972eaa-0a1b-4575-bc07-75ef1f461019 tempest-AttachVolumeNegativeTest-2135233649 None] Terminate volume connection completed successfully. Nov 13 21:34:00.642664 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-5c35a3b7-64d5-4565-9ffc-98a8255373fb req-3b972eaa-0a1b-4575-bc07-75ef1f461019 tempest-AttachVolumeNegativeTest-2135233649 None] Deleting attachment b73dcfee-50a5-40e0-8912-6dc482433c52. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:34:01.563498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:34:01.860822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] deleting parent snapshot volume-d625332a-ae4e-48de-8f45-0bb6ba890ff5.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:34:04.667057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Volume volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:04.669772 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:34:04.670363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:34:05.071008 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] resize volume 'volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78' from 1 to 2 {{(pid=129109) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:693}} Nov 13 21:34:05.074000 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:05.352272 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:34:05.356044 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:34:05.356523 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:34:05.367910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Flow 'volume_create_manager' (042b900e-af4c-4058-9815-bb20f47f1de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:05.370954 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fda11-283a-4b41-87fb-3c086dc5160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:05.378258 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:34:05.379607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] Created reservations ['a302c856-e9a9-4f77-ae9e-3636de88df94', 'f7d1ddb0-0cca-40b7-9e84-f4b0d6058ef0', 'cc4bc36e-2ecc-4b46-9a73-026f2ba693cc', '54288bf7-07ca-4bd8-92d0-118e2d085094'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:34:05.395512 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fda11-283a-4b41-87fb-3c086dc5160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-2002097192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=410acec1-b74d-4a4c-a7cd-44223533cde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb7ad13c9ca4cdc82aa3c91c886f406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:34:05Z,use_quota=True,user_id='9ba9c200188942ae94c1fe4868ed16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:05.398049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0235ba-0d64-4ba9-9dfb-e66864d2f90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:05.400183 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0235ba-0d64-4ba9-9dfb-e66864d2f90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:05.402588 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f46236-bc50-494e-bac0-2b369ee5176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:05.533680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0f46236-bc50-494e-bac0-2b369ee5176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '410acec1-b74d-4a4c-a7cd-44223533cde2', 'volume_name': 'volume-410acec1-b74d-4a4c-a7cd-44223533cde2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:05.539175 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47063f25-4997-498d-86ee-e41e8d8950b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:05.539175 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47063f25-4997-498d-86ee-e41e8d8950b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:05.545924 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6d4f2f-0dac-4e5e-a155-7b98e197708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:05.546797 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Volume 410acec1-b74d-4a4c-a7cd-44223533cde2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-410acec1-b74d-4a4c-a7cd-44223533cde2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:34:05.547373 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Cloning 410acec1-b74d-4a4c-a7cd-44223533cde2 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:34:05.569442 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.020s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:05.721573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:05.745355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:05.773321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:34:05.779532 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 34, 5, 584389)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:34:05.779532 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:34:05.779752 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:34:05.786195 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] Deleted volume successfully. Nov 13 21:34:05.789472 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.220s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:34:05.790318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:34:05.796859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 34, 5, 794371)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:34:05.797279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:34:05.797679 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:34:05.810180 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:06.019559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] creating snapshot='volume-410acec1-b74d-4a4c-a7cd-44223533cde2.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:34:08.440061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-410acec1-b74d-4a4c-a7cd-44223533cde2.clone_snap' to 'volume-410acec1-b74d-4a4c-a7cd-44223533cde2' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:34:08.505910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:34:08.513014 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5d1c75e-7d7c-4e03-8fc2-2ee83b5b9e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78', 'volume_size': 2, 'source_volid': '8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751', 'source_volstatus': 'available'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.513014 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941384a0-6c0f-4373-9d8b-c9beb454f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.557503 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7202ace5-2b25-437a-b24a-a24ffd95a86f tempest-TaggedBootDevicesTest-27436268 None] Lock "b'cinder-d625332a-ae4e-48de-8f45-0bb6ba890ff5-delete_volume'" released by "delete_volume" :: held 15.033s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:34:08.604304 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Volume volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78 (c73593d0-2962-45ce-ab73-6bef0d7a3c78): created successfully Nov 13 21:34:08.608581 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (941384a0-6c0f-4373-9d8b-c9beb454f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.612517 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Flow 'volume_create_manager' (944dac8a-0a51-47cb-9981-2aad360e92ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:08.632162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:34:08.637353 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:34:08.637946 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:34:08.653971 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (bdb3c08b-b5eb-4513-841f-a0f979fab0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:08.659304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8346a37-0c69-447f-b097-de6d4f67a786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.673359 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:34:08.682903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8346a37-0c69-447f-b097-de6d4f67a786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1724439568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=22af9efd-4c67-49c5-8130-53aa4c6fead3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f2f838a4bc4b5dae3e6668d7634ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:34:08Z,use_quota=True,user_id='0b32ce6788014ce8bf54f77b72dc6a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.685599 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c9702-7c2e-49c0-864d-412fd8460bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.688117 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c9702-7c2e-49c0-864d-412fd8460bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.691615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1161846e-04b1-44f5-9dd0-15909d4612b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.696336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1161846e-04b1-44f5-9dd0-15909d4612b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22af9efd-4c67-49c5-8130-53aa4c6fead3', 'volume_name': 'volume-22af9efd-4c67-49c5-8130-53aa4c6fead3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.697002 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd732d2-db67-42ac-9cf2-9da55a59fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.700222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd732d2-db67-42ac-9cf2-9da55a59fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:08.702781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959d3d38-62b2-4471-aaf8-ebdc67f6b60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:08.703789 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Volume 22af9efd-4c67-49c5-8130-53aa4c6fead3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22af9efd-4c67-49c5-8130-53aa4c6fead3', 'volume_size': 1} Nov 13 21:34:08.704438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] creating volume 'volume-22af9efd-4c67-49c5-8130-53aa4c6fead3' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:34:08.705817 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:08.761642 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1a92dde9-23a4-44a3-81c7-2cfc3803c223 tempest-VolumesCloneTest-2027550173 None] Created volume successfully. Nov 13 21:34:09.682096 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-c73593d0-2962-45ce-ab73-6bef0d7a3c78-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:09.811915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:10.190613 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:34:10.443045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] deleting rbd volume volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:34:10.447565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:34:10.448217 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:34:10.452171 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959d3d38-62b2-4471-aaf8-ebdc67f6b60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22af9efd-4c67-49c5-8130-53aa4c6fead3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:10.455026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be47a5-5598-434e-b8cc-4257cbae0a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:10.540019 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-22af9efd-4c67-49c5-8130-53aa4c6fead3 (22af9efd-4c67-49c5-8130-53aa4c6fead3): created successfully Nov 13 21:34:10.544078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24be47a5-5598-434e-b8cc-4257cbae0a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:10.547266 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (bdb3c08b-b5eb-4513-841f-a0f979fab0eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:10.613817 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:10.616816 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:34:10.618719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:34:11.547423 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:34:11.553152 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Marking volume 410acec1-b74d-4a4c-a7cd-44223533cde2 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:34:11.553152 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-139ede20-5054-439c-a6d9-925bfe4f9c21 tempest-AttachVolumeTestJSON-1492305703 None] Created volume successfully. Nov 13 21:34:11.652525 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 410acec1-b74d-4a4c-a7cd-44223533cde2. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:34:11.652964 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Creating volume glance metadata for volume 410acec1-b74d-4a4c-a7cd-44223533cde2 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:34:11.821062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6d4f2f-0dac-4e5e-a155-7b98e197708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410acec1-b74d-4a4c-a7cd-44223533cde2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:11.823237 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3a28d9-6b25-4e68-8626-02b7b126df0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:11.938888 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Volume volume-410acec1-b74d-4a4c-a7cd-44223533cde2 (410acec1-b74d-4a4c-a7cd-44223533cde2): created successfully Nov 13 21:34:11.940988 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b3a28d9-6b25-4e68-8626-02b7b126df0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:11.946563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Flow 'volume_create_manager' (042b900e-af4c-4058-9815-bb20f47f1de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:12.036126 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e7b709ff-969d-486d-84da-ee57782e8c1b tempest-TestVolumeBackupRestore-355465777 None] Created volume successfully. Nov 13 21:34:12.425432 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-5e11c5e5-9ff5-4142-9fdb-368e1e25d11c req-c6da5fc2-a320-4de0-98b4-91121a211713 tempest-AttachVolumeTestJSON-1492305703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:34:13.150823 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-5e11c5e5-9ff5-4142-9fdb-368e1e25d11c req-c6da5fc2-a320-4de0-98b4-91121a211713 tempest-AttachVolumeTestJSON-1492305703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.725s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:34:13.152396 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e11c5e5-9ff5-4142-9fdb-368e1e25d11c req-c6da5fc2-a320-4de0-98b4-91121a211713 tempest-AttachVolumeTestJSON-1492305703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-22af9efd-4c67-49c5-8130-53aa4c6fead3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '22af9efd-4c67-49c5-8130-53aa4c6fead3', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:34:13.259426 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-5e11c5e5-9ff5-4142-9fdb-368e1e25d11c req-c6da5fc2-a320-4de0-98b4-91121a211713 tempest-AttachVolumeTestJSON-1492305703 None] Connection info returned from driver {'name': 'volumes/volume-22af9efd-4c67-49c5-8130-53aa4c6fead3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '22af9efd-4c67-49c5-8130-53aa4c6fead3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a68657c9-c295-4c59-8a86-0ddd01167bfd'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:34:13.378536 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-5e11c5e5-9ff5-4142-9fdb-368e1e25d11c req-c6da5fc2-a320-4de0-98b4-91121a211713 tempest-AttachVolumeTestJSON-1492305703 None] attachment_update completed successfully. Nov 13 21:34:13.493684 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:34:14.170653 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:34:14.172070 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-410acec1-b74d-4a4c-a7cd-44223533cde2', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '410acec1-b74d-4a4c-a7cd-44223533cde2', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:34:14.189544 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] Initialize volume connection completed successfully. Nov 13 21:34:15.619500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:34:15.625709 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:34:15.626548 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:34:15.644235 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (0740b7f8-d07e-4eb0-9452-9eab350cc717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:15.646857 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b548f9-e12b-4a74-aabb-79eb78fa6571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:15.653504 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:34:15.671885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8b548f9-e12b-4a74-aabb-79eb78fa6571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1618495239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b13e657-5e71-4d52-ac29-9b3617d26ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ca896180bd14166b581f7c307622554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:34:15Z,use_quota=True,user_id='fd17d86cfc744091b8d1a56086ded771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:15.674467 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af5212-ca5a-48fd-af31-e60667b2e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:15.677288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5af5212-ca5a-48fd-af31-e60667b2e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:15.682968 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bd7cd3-8120-4771-8b9b-23b99c50bd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:15.685851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05bd7cd3-8120-4771-8b9b-23b99c50bd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'volume_name': 'volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:15.688067 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240046c-5bfc-4377-8911-ed5113de53c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:15.690125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2240046c-5bfc-4377-8911-ed5113de53c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:15.692546 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00593f0-d150-4548-a9cb-cb6993598f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:15.695964 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Volume 7b13e657-5e71-4d52-ac29-9b3617d26ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'volume_size': 1} Nov 13 21:34:15.695964 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] creating volume 'volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:34:15.695964 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:16.015550 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:34:16.220048 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Volume volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:16.220570 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] deleting parent snapshot volume-c73593d0-2962-45ce-ab73-6bef0d7a3c78.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:34:21.225757 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:34:21.226513 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:21.253571 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:21.284086 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:34:21.291835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:34:21.292210 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:34:21.294191 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d00593f0-d150-4548-a9cb-cb6993598f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:21.296914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b691364-54a6-4c9b-949a-bd11688d88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:34:21.442738 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Created reservations ['0d3763a7-38b6-483b-a96d-b4f76e923c84', '835674a0-d5de-439b-b27e-912579d37a34', '321f3eca-2914-41dc-9703-f591d24f8997', '37923821-4f1d-4889-ae62-1940153d302a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:34:21.445997 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8 (7b13e657-5e71-4d52-ac29-9b3617d26ff8): created successfully Nov 13 21:34:21.447955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b691364-54a6-4c9b-949a-bd11688d88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:34:21.452189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Flow 'volume_create_manager' (0740b7f8-d07e-4eb0-9452-9eab350cc717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:34:21.522446 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6269d2c3-e0c5-4b97-91bf-952e7b12e682 tempest-AttachVolumeNegativeTest-2135233649 None] Created volume successfully. Nov 13 21:34:21.728848 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:21.849203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:21.884652 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:34:21.888807 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Deleted volume successfully. Nov 13 21:34:21.946602 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:22.016080 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8bf7526c-2d82-43bc-8e23-2899c7e5e304 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-c73593d0-2962-45ce-ab73-6bef0d7a3c78-delete_volume'" released by "delete_volume" :: held 12.334s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:34:22.088143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:22.461894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:34:22.462617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Volume volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:22.832257 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] deleting rbd volume volume-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:34:22.871392 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-5a2d232e-6fcb-4fdc-8aa3-dac4422fe047 req-f5f8a7fc-cc9e-412a-8626-b2fd2dec7a32 tempest-AttachVolumeNegativeTest-2135233649 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:34:23.522342 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-5a2d232e-6fcb-4fdc-8aa3-dac4422fe047 req-f5f8a7fc-cc9e-412a-8626-b2fd2dec7a32 tempest-AttachVolumeNegativeTest-2135233649 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.652s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:34:23.523135 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5a2d232e-6fcb-4fdc-8aa3-dac4422fe047 req-f5f8a7fc-cc9e-412a-8626-b2fd2dec7a32 tempest-AttachVolumeNegativeTest-2135233649 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:34:23.619645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-5a2d232e-6fcb-4fdc-8aa3-dac4422fe047 req-f5f8a7fc-cc9e-412a-8626-b2fd2dec7a32 tempest-AttachVolumeNegativeTest-2135233649 None] Connection info returned from driver {'name': 'volumes/volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7b13e657-5e71-4d52-ac29-9b3617d26ff8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5066b4bf-4534-4b49-bc31-183df4ed3aeb'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:34:23.727305 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-5a2d232e-6fcb-4fdc-8aa3-dac4422fe047 req-f5f8a7fc-cc9e-412a-8626-b2fd2dec7a32 tempest-AttachVolumeNegativeTest-2135233649 None] attachment_update completed successfully. Nov 13 21:34:29.151624 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-b5bf2c4c-ba8c-48e9-8d84-d97924da8129 req-b98ec200-7edd-4162-b8dd-56542ea45cb6 tempest-AttachVolumeNegativeTest-2135233649 None] Terminate volume connection completed successfully. Nov 13 21:34:29.152327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-b5bf2c4c-ba8c-48e9-8d84-d97924da8129 req-b98ec200-7edd-4162-b8dd-56542ea45cb6 tempest-AttachVolumeNegativeTest-2135233649 None] Deleting attachment 5066b4bf-4534-4b49-bc31-183df4ed3aeb. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:34:29.892272 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-7b13e657-5e71-4d52-ac29-9b3617d26ff8-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:29.968175 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:30.910398 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:34:30.911059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:31.214932 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] deleting rbd volume volume-7b13e657-5e71-4d52-ac29-9b3617d26ff8 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:34:36.894063 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Created reservations ['f42464a3-172e-4da8-bfb0-e40b6e693e77', 'a541b313-3ba9-4e80-86ae-a7e354c531db', '329885f1-c4b4-4ba2-8e1c-2f06e0e7502a', '67792467-3c1c-4414-89b4-dd1f948fb7b1'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:34:37.106732 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:37.136189 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:37.163994 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:34:37.169391 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Deleted volume successfully. Nov 13 21:34:37.232665 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-559d9fb2-d6db-496c-b090-47e3943e45ee tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-8a542a1d-45e8-4fa0-9b9e-6cf8c91ea751-delete_volume'" released by "delete_volume" :: held 15.284s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:34:37.946792 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-24a53419-6b7e-4e6e-8a2c-972674b69ac6-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:38.054310 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:40.450746 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:34:41.225527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] deleting rbd volume volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:34:45.608045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Created reservations ['3ff72869-5577-4bfb-b760-fad24e7e7769', '1ccc1946-3e78-46b3-a2f2-ee8c5f10c09f', '6060c8cc-2ee5-4948-bb88-6151e67df902', '12233863-3e2d-4555-8992-f889beb44177'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:34:45.837299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:45.859436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:45.882742 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:34:45.888317 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Deleted volume successfully. Nov 13 21:34:46.000222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-59ce2426-e231-4538-9639-0d34c895f143 tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-7b13e657-5e71-4d52-ac29-9b3617d26ff8-delete_volume'" released by "delete_volume" :: held 16.162s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:34:50.971915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-182cff1a-9ccd-4c85-860e-24293a524f7d-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:34:51.093134 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:34:51.471388 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:34:51.471817 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-182cff1a-9ccd-4c85-860e-24293a524f7d is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:34:52.006038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] deleting rbd volume volume-182cff1a-9ccd-4c85-860e-24293a524f7d {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:34:55.294090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:34:56.962797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] deleting parent snapshot volume-24a53419-6b7e-4e6e-8a2c-972674b69ac6.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:35:03.053020 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] Created reservations ['5becfb3f-1b55-44e3-bf0c-dbd29a562e82', 'a570a597-f344-4b6b-a6e7-f5658bdf0ac5', '0712e9b1-361c-475c-ac82-75c26eede29a', '65e2c7b1-5106-4a1e-b75c-ef284251a777'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:35:03.220547 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:03.261954 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:03.295160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:03.301660 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] Deleted volume successfully. Nov 13 21:35:03.471348 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-affb50cd-92b8-4459-8cc1-e0309c9a2217 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-24a53419-6b7e-4e6e-8a2c-972674b69ac6-delete_volume'" released by "delete_volume" :: held 25.526s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:35:03.529581 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-dc7e43ff-2fd0-436b-8fed-1a164630fe09-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:35:03.659462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:04.402392 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:35:04.691559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] deleting rbd volume volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:35:04.705449 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-073ac068-9c43-4843-8332-3dec34c51b1c req-0ad8e849-671b-4d99-85bc-4a843a5752f7 tempest-AttachVolumeTestJSON-1492305703 None] Terminate volume connection completed successfully. Nov 13 21:35:04.705847 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-073ac068-9c43-4843-8332-3dec34c51b1c req-0ad8e849-671b-4d99-85bc-4a843a5752f7 tempest-AttachVolumeTestJSON-1492305703 None] Deleting attachment a68657c9-c295-4c59-8a86-0ddd01167bfd. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:35:04.911476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Created reservations ['1f39451d-d840-43ee-969e-3dba4fe1fafe', 'b5048c67-0522-4a48-88d2-de4726601269', 'b7596272-2336-4ba6-aeee-1fea7d144217', '608b4b52-fec4-48ac-a1e8-3a5d4c9dd188'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:35:05.174316 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:05.196134 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:05.217542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:05.221631 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Deleted volume successfully. Nov 13 21:35:05.314968 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e902d222-0dca-4aad-99ee-7fc5753a6cb2 tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-182cff1a-9ccd-4c85-860e-24293a524f7d-delete_volume'" released by "delete_volume" :: held 14.343s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:35:11.283129 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:35:11.495269 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] deleting parent snapshot volume-dc7e43ff-2fd0-436b-8fed-1a164630fe09.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:35:14.528823 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-93cbe274-4d0a-4195-b7e7-0a02eeb0b407-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:35:14.542615 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] Terminate volume connection completed successfully. Nov 13 21:35:14.570502 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1df3a163-b80c-4551-a3c2-d7059d3c51b2 tempest-TestVolumeBackupRestore-355465777 None] Remove volume export completed successfully. Nov 13 21:35:14.658390 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] Created reservations ['b0b5dfbe-8351-4093-a4da-2d057689d434', '2ffb4383-0c14-48c6-b51a-86d668d29950', 'eaf241d1-b5a4-408f-8b3d-0cc3fd71bb5e', 'd306c995-394a-4d9e-854e-7ab02413b6da'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:35:14.837675 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:14.967660 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:35:14.968078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Volume volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:35:15.042805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] deleting rbd volume volume-93cbe274-4d0a-4195-b7e7-0a02eeb0b407 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:35:15.134125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:15.165976 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:15.191740 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:15.196604 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] Deleted volume successfully. Nov 13 21:35:15.274135 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2408b204-4974-41f3-8e13-1efc420b35b2 tempest-VolumesCloneTest-2027550173 None] Lock "b'cinder-dc7e43ff-2fd0-436b-8fed-1a164630fe09-delete_volume'" released by "delete_volume" :: held 11.745s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:35:16.793132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:35:16.797840 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:35:16.798317 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:35:16.811616 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Flow 'volume_create_manager' (1f70c8b2-6aa8-41b5-b0c1-0c1782af2fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:35:16.814779 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790efc30-d151-4852-bf96-56db57ffe9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:16.821006 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:35:16.836137 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (790efc30-d151-4852-bf96-56db57ffe9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:35:16Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_929d00cf-2b10-4765-899c-662d1c38ac0f',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=86820b45-ab53-44db-896f-e5f387a2ced9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb7ad13c9ca4cdc82aa3c91c886f406',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:35:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:35:17Z,use_quota=True,user_id='9ba9c200188942ae94c1fe4868ed16fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:16.838651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46564a82-84b0-46a8-94ac-8e3ff99a35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:16.840815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46564a82-84b0-46a8-94ac-8e3ff99a35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:16.843068 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76d759-6936-460d-af2c-4b5bfec53347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:16.845295 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e76d759-6936-460d-af2c-4b5bfec53347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86820b45-ab53-44db-896f-e5f387a2ced9', 'volume_name': 'volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:16.847530 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6215e17-4149-46b3-9798-d17d01239a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:16.850322 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6215e17-4149-46b3-9798-d17d01239a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:16.852443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943914a-058d-46a4-9af5-bf10f84867e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:16.853312 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Volume 86820b45-ab53-44db-896f-e5f387a2ced9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'volume_size': 1} Nov 13 21:35:16.853646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] creating volume 'volume-86820b45-ab53-44db-896f-e5f387a2ced9' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:35:16.855537 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:18.262407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:35:18.263055 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:35:18.264802 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8943914a-058d-46a4-9af5-bf10f84867e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.266895 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f671a1e0-3b16-4289-9a44-17b401ead646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.447869 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Volume volume-86820b45-ab53-44db-896f-e5f387a2ced9 (86820b45-ab53-44db-896f-e5f387a2ced9): created successfully Nov 13 21:35:18.450071 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f671a1e0-3b16-4289-9a44-17b401ead646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.453235 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Flow 'volume_create_manager' (1f70c8b2-6aa8-41b5-b0c1-0c1782af2fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:35:18.495658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:35:18.499195 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:35:18.499806 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:35:18.512578 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Flow 'volume_create_manager' (2e7c990f-4fb1-4991-9bcb-d596e775a239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:35:18.515638 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cca9d15-171b-42da-ae8c-65a2c3f57b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.521721 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:35:18.534857 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cca9d15-171b-42da-ae8c-65a2c3f57b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-897138344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb92a5d3-de95-4a14-abd3-639657eab66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260525d2607b46c7ae759af59ec0fc1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:35:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:35:18Z,use_quota=True,user_id='eed82e5743e24445b91baf78dfb70877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.537878 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe693b8-209a-443c-bf68-08dee7356d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.539977 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efe693b8-209a-443c-bf68-08dee7356d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.544258 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c86231-911c-4cbb-bf1f-3b372d353f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.544425 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c86231-911c-4cbb-bf1f-3b372d353f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb92a5d3-de95-4a14-abd3-639657eab66e', 'volume_name': 'volume-cb92a5d3-de95-4a14-abd3-639657eab66e', 'volume_size': 2}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.546656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8545ec-39e4-439a-9656-2c6ed6ec8b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.548661 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8545ec-39e4-439a-9656-2c6ed6ec8b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:18.550776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79764a2-2ad0-42ff-b794-e4ae8782e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:18.551521 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Volume cb92a5d3-de95-4a14-abd3-639657eab66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb92a5d3-de95-4a14-abd3-639657eab66e', 'volume_size': 2} Nov 13 21:35:18.551903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] creating volume 'volume-cb92a5d3-de95-4a14-abd3-639657eab66e' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:35:18.553444 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:18.585961 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Created volume successfully. Nov 13 21:35:18.910800 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:35:19.682584 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.771s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:35:19.683359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '86820b45-ab53-44db-896f-e5f387a2ced9', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:35:19.698397 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Initialize volume connection completed successfully. Nov 13 21:35:19.712216 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:35:19.712805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:35:19.715758 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79764a2-2ad0-42ff-b794-e4ae8782e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb92a5d3-de95-4a14-abd3-639657eab66e', 'volume_size': 2}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:19.718184 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da74c0f-d9fa-4ac5-81a6-3b775ab03ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:35:19.814264 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Volume volume-cb92a5d3-de95-4a14-abd3-639657eab66e (cb92a5d3-de95-4a14-abd3-639657eab66e): created successfully Nov 13 21:35:19.816327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da74c0f-d9fa-4ac5-81a6-3b775ab03ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:35:19.819545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Flow 'volume_create_manager' (2e7c990f-4fb1-4991-9bcb-d596e775a239) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:35:19.961245 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bba7e8c7-0063-4ce5-a1d0-b8671893dd8f tempest-VolumesCloneNegativeTest-567639961 None] Created volume successfully. Nov 13 21:35:20.614069 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Lock "b'cinder-cb92a5d3-de95-4a14-abd3-639657eab66e-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:35:20.722774 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:20.905443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:35:20.905895 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Volume volume-cb92a5d3-de95-4a14-abd3-639657eab66e is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:35:21.127187 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] deleting rbd volume volume-cb92a5d3-de95-4a14-abd3-639657eab66e {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:35:21.222522 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:35:21.223985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:21.246446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:21.274415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:21.280246 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Created reservations ['99d0cb83-a2f3-4b12-98f7-95deaa9527ec', 'ab99de54-09d3-4e3d-9060-7c0a34cfca88', '70ef8a9f-9623-4ee6-9298-8012c83b1b9a', '7aec308e-324f-4db8-ad45-d25a1081f600'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:35:21.481573 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:21.503074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:21.525658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:21.530251 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Deleted volume successfully. Nov 13 21:35:21.622858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-af23ffd7-a7e4-46fb-a534-c010a5bdb0df tempest-AttachVolumeNegativeTest-2135233649 None] Lock "b'cinder-93cbe274-4d0a-4195-b7e7-0a02eeb0b407-delete_volume'" released by "delete_volume" :: held 7.094s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:35:31.501649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Created reservations ['b3329190-becf-4a43-93d3-f5937e3ed21b', '9ed8b8e3-54db-4e04-887d-7a846f3ec18c', '02a79dc1-ae21-4716-99c9-3f8683681fcc', 'e5c9f7d8-1c32-494d-9331-468ef3cea00f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:35:31.849030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:31.893195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:35:31.955209 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:35:31.959324 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Deleted volume successfully. Nov 13 21:35:32.053072 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-69851112-763a-4cc6-a354-7bd234280779 tempest-VolumesCloneNegativeTest-567639961 None] Lock "b'cinder-cb92a5d3-de95-4a14-abd3-639657eab66e-delete_volume'" released by "delete_volume" :: held 11.439s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:36:07.765709 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Terminate volume connection completed successfully. Nov 13 21:36:07.782640 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-70726fef-ae14-4acc-beeb-9af9e334935a tempest-TestVolumeBackupRestore-355465777 None] Remove volume export completed successfully. Nov 13 21:36:14.921072 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1312148c-e983-4239-a71a-7517f6d671b4 req-39981b89-52e9-42bc-9ca2-215814501cee tempest-TestVolumeBackupRestore-355465777 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:36:15.133412 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:36:15.137267 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:36:15.137769 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:36:15.155526 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Flow 'volume_create_manager' (b2efbfa7-f0f1-4530-85e3-4bc2acf9f30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:36:15.160044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0413c17e-e5ab-4ae9-8066-34bb54ed2e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.166960 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:36:15.183212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0413c17e-e5ab-4ae9-8066-34bb54ed2e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:36:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-650176211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=550fabe3-056c-47e1-9392-db8eafa8b400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac3cb8b49c4b22974bcd78a16f2a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:36:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:36:15Z,use_quota=True,user_id='fbad1d7219b942888355f1ed107ce556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.186566 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed74a0d-4bcc-458c-a35d-df8f776ce43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.189695 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fed74a0d-4bcc-458c-a35d-df8f776ce43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.193304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29fbb5e-b749-4abe-9ed2-59dd94f4ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.196014 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29fbb5e-b749-4abe-9ed2-59dd94f4ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '550fabe3-056c-47e1-9392-db8eafa8b400', 'volume_name': 'volume-550fabe3-056c-47e1-9392-db8eafa8b400', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.198666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bf308a-fd67-474e-9f76-a6e471f5812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.201406 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88bf308a-fd67-474e-9f76-a6e471f5812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.204652 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ea1e3c-1f4b-4855-9a6c-eca765283b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.205009 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Volume 550fabe3-056c-47e1-9392-db8eafa8b400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-550fabe3-056c-47e1-9392-db8eafa8b400', 'volume_size': 1} Nov 13 21:36:15.205644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] creating volume 'volume-550fabe3-056c-47e1-9392-db8eafa8b400' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:36:15.207205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:36:15.773027 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-1312148c-e983-4239-a71a-7517f6d671b4 req-39981b89-52e9-42bc-9ca2-215814501cee tempest-TestVolumeBackupRestore-355465777 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.852s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:36:15.774676 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-1312148c-e983-4239-a71a-7517f6d671b4 req-39981b89-52e9-42bc-9ca2-215814501cee tempest-TestVolumeBackupRestore-355465777 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '86820b45-ab53-44db-896f-e5f387a2ced9', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:36:15.883756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-1312148c-e983-4239-a71a-7517f6d671b4 req-39981b89-52e9-42bc-9ca2-215814501cee tempest-TestVolumeBackupRestore-355465777 None] Connection info returned from driver {'name': 'volumes/volume-86820b45-ab53-44db-896f-e5f387a2ced9', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '86820b45-ab53-44db-896f-e5f387a2ced9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '297302c2-dcb3-4201-a96d-88c4ebbe6300'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:36:15.889681 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:36:15.891052 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:36:15.894049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ea1e3c-1f4b-4855-9a6c-eca765283b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-550fabe3-056c-47e1-9392-db8eafa8b400', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.896756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a9bc4e-f9c7-4390-b3c2-bf0ef732bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:15.980291 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Volume volume-550fabe3-056c-47e1-9392-db8eafa8b400 (550fabe3-056c-47e1-9392-db8eafa8b400): created successfully Nov 13 21:36:15.982282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21a9bc4e-f9c7-4390-b3c2-bf0ef732bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:15.985471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Flow 'volume_create_manager' (b2efbfa7-f0f1-4530-85e3-4bc2acf9f30d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:36:16.036362 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-1312148c-e983-4239-a71a-7517f6d671b4 req-39981b89-52e9-42bc-9ca2-215814501cee tempest-TestVolumeBackupRestore-355465777 None] attachment_update completed successfully. Nov 13 21:36:16.088804 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cf15f87c-8e49-48cb-89e7-fcea79e3cfcc tempest-ServersNegativeTestJSON-1640442432 None] Created volume successfully. Nov 13 21:36:18.936031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:36:18.950965 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:36:18.956044 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:36:18.974978 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Flow 'volume_create_manager' (40a62075-58ce-426a-96aa-2cd98ddd912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:36:18.980335 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ced4f73-b0e5-49e5-8792-c94979c50443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:18.987356 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:36:19.001954 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ced4f73-b0e5-49e5-8792-c94979c50443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-370294172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5d7351d-b369-4ab0-bd72-c3162ec9e452,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37ac3cb8b49c4b22974bcd78a16f2a3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:36:19Z,use_quota=True,user_id='fbad1d7219b942888355f1ed107ce556',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.005271 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aefb386-8483-48d9-8ff0-8dc2a3e7b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:19.009458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aefb386-8483-48d9-8ff0-8dc2a3e7b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.015073 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1bcdb8-33f3-44e3-8c18-f3686870bfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:19.015073 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1bcdb8-33f3-44e3-8c18-f3686870bfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d7351d-b369-4ab0-bd72-c3162ec9e452', 'volume_name': 'volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.017178 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d972bc-3cd9-4de3-b2db-a2d9e3a5f18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:19.019559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d972bc-3cd9-4de3-b2db-a2d9e3a5f18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.021919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718b6c47-d389-45cd-a32f-eeb48363c37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:19.022790 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Volume f5d7351d-b369-4ab0-bd72-c3162ec9e452: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452', 'volume_size': 1} Nov 13 21:36:19.023416 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] creating volume 'volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:36:19.025205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:36:19.537641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:36:19.538113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:36:19.540926 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718b6c47-d389-45cd-a32f-eeb48363c37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.544010 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bc534f-efbc-4b2a-ad9d-c707bec7cacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:36:19.631472 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Volume volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452 (f5d7351d-b369-4ab0-bd72-c3162ec9e452): created successfully Nov 13 21:36:19.634370 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30bc534f-efbc-4b2a-ad9d-c707bec7cacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:36:19.637642 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Flow 'volume_create_manager' (40a62075-58ce-426a-96aa-2cd98ddd912b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:36:19.751124 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b2af8850-2ae5-4b6d-91ac-175789281ccf tempest-ServersNegativeTestJSON-1640442432 None] Created volume successfully. Nov 13 21:36:21.225624 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:36:21.225624 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:36:21.292639 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:36:21.323906 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:37:21.222583 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:37:21.223325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:21.270143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:21.338560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:37:44.901329 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Lock "b'cinder-f5d7351d-b369-4ab0-bd72-c3162ec9e452-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:37:45.004195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:45.310956 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:37:45.311407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Volume volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:37:45.409265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] deleting rbd volume volume-f5d7351d-b369-4ab0-bd72-c3162ec9e452 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:37:52.894590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Created reservations ['43d94a72-20ec-46ea-8825-05704b993a4f', '6b6b7a97-3203-47c2-b7dd-c7f35d15bfca', '0dadbc07-66e9-45e5-89f3-8e51bd77ab5c', '87882cf0-71d7-4b42-a2b9-abb6bd69e2ee'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:37:53.048861 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:53.085250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:53.134268 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:37:53.140839 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Deleted volume successfully. Nov 13 21:37:53.232367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d4ca074f-eebb-4ee5-afc8-486ce32a1f64 tempest-ServersNegativeTestJSON-1640442432 None] Lock "b'cinder-f5d7351d-b369-4ab0-bd72-c3162ec9e452-delete_volume'" released by "delete_volume" :: held 8.329s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:37:53.626334 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Lock "b'cinder-550fabe3-056c-47e1-9392-db8eafa8b400-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:37:53.714165 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:53.929578 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:37:53.930268 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Volume volume-550fabe3-056c-47e1-9392-db8eafa8b400 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:37:54.157363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] deleting rbd volume volume-550fabe3-056c-47e1-9392-db8eafa8b400 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:37:55.547661 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:37:55.551637 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:37:55.552323 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:37:55.564879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (e5e1dba5-e5c1-4473-9cd1-1f7c14576215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:37:55.567905 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cbfdff-fa62-4c26-bd8b-d7f658f44fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:55.574452 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:37:55.589424 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0cbfdff-fa62-4c26-bd8b-d7f658f44fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-699002046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=43964ce0-242c-4106-857c-b7b27b1766e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f2f838a4bc4b5dae3e6668d7634ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:37:55Z,use_quota=True,user_id='0b32ce6788014ce8bf54f77b72dc6a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:55.592126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6165ec67-3084-41be-8507-9b87b86a5fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:55.594751 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6165ec67-3084-41be-8507-9b87b86a5fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:55.597337 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5fa52-a456-4278-84c5-757b71ba3190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:55.599658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb5fa52-a456-4278-84c5-757b71ba3190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43964ce0-242c-4106-857c-b7b27b1766e3', 'volume_name': 'volume-43964ce0-242c-4106-857c-b7b27b1766e3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:55.602187 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7555470-7c99-4743-8677-6497622e3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:55.605080 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7555470-7c99-4743-8677-6497622e3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:55.607444 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd39f051-242a-431d-9217-d42b8dacd3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:55.608430 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Volume 43964ce0-242c-4106-857c-b7b27b1766e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43964ce0-242c-4106-857c-b7b27b1766e3', 'volume_size': 1} Nov 13 21:37:55.609031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] creating volume 'volume-43964ce0-242c-4106-857c-b7b27b1766e3' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:37:55.610184 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:37:56.326773 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:37:56.327154 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:37:56.329294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd39f051-242a-431d-9217-d42b8dacd3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43964ce0-242c-4106-857c-b7b27b1766e3', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:56.331634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb408382-928e-406d-aa8f-63b2ee94d3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:37:56.425653 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-43964ce0-242c-4106-857c-b7b27b1766e3 (43964ce0-242c-4106-857c-b7b27b1766e3): created successfully Nov 13 21:37:56.427649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb408382-928e-406d-aa8f-63b2ee94d3c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:37:56.430516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (e5e1dba5-e5c1-4473-9cd1-1f7c14576215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:37:56.620078 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9697360b-38c7-4180-be70-af8f892a09cd tempest-AttachVolumeTestJSON-1492305703 None] Created volume successfully. Nov 13 21:37:58.464710 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-b234ff1c-debe-4ac5-aaa8-8499cc6c3297 req-e6fd40d5-df30-4bc9-9304-e7339aea55a2 tempest-AttachVolumeTestJSON-1492305703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:37:59.170935 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-b234ff1c-debe-4ac5-aaa8-8499cc6c3297 req-e6fd40d5-df30-4bc9-9304-e7339aea55a2 tempest-AttachVolumeTestJSON-1492305703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.706s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:37:59.180885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-b234ff1c-debe-4ac5-aaa8-8499cc6c3297 req-e6fd40d5-df30-4bc9-9304-e7339aea55a2 tempest-AttachVolumeTestJSON-1492305703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-43964ce0-242c-4106-857c-b7b27b1766e3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '43964ce0-242c-4106-857c-b7b27b1766e3', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:37:59.342088 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-b234ff1c-debe-4ac5-aaa8-8499cc6c3297 req-e6fd40d5-df30-4bc9-9304-e7339aea55a2 tempest-AttachVolumeTestJSON-1492305703 None] Connection info returned from driver {'name': 'volumes/volume-43964ce0-242c-4106-857c-b7b27b1766e3', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '43964ce0-242c-4106-857c-b7b27b1766e3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a8799a2c-5158-4c3e-8150-fd84c04aedb7'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:37:59.454381 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-b234ff1c-debe-4ac5-aaa8-8499cc6c3297 req-e6fd40d5-df30-4bc9-9304-e7339aea55a2 tempest-AttachVolumeTestJSON-1492305703 None] attachment_update completed successfully. Nov 13 21:38:02.985705 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Created reservations ['87e7c9eb-511a-4660-a9c6-0b8fefb590da', '0b4da188-f2c7-4f2a-842b-7d9652999d1f', 'dc2220b2-f31c-46e4-9a5c-8ebdac681fd0', 'abad7190-888f-40a2-a1d1-12d4ea4d3243'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:03.286818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:03.415679 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:03.481328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:03.486140 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Deleted volume successfully. Nov 13 21:38:03.573305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-004b8422-147a-46cf-9f50-90096b61b455 tempest-ServersNegativeTestJSON-1640442432 None] Lock "b'cinder-550fabe3-056c-47e1-9392-db8eafa8b400-delete_volume'" released by "delete_volume" :: held 9.946s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:03.660249 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:38:03.664147 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:38:03.664631 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:38:03.680985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (8f52296d-1745-4c18-b33e-0160e445d159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:38:03.717607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc23bf4-962f-4f0b-a0eb-d955bf237dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:03.724230 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:38:03.738934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc23bf4-962f-4f0b-a0eb-d955bf237dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1209274052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9c0ccd7c-f89b-4ebd-abcd-df5344553309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88f2f838a4bc4b5dae3e6668d7634ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:38:03Z,use_quota=True,user_id='0b32ce6788014ce8bf54f77b72dc6a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:03.742040 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768037c0-873f-48ed-a629-92f85f461306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:03.744795 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (768037c0-873f-48ed-a629-92f85f461306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:03.747341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ff187-5e87-40b2-bf0d-e6e9f4a81ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:03.749783 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e9ff187-5e87-40b2-bf0d-e6e9f4a81ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'volume_name': 'volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:03.752257 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde5d126-5b9a-4793-9de9-97be5676aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:03.756734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde5d126-5b9a-4793-9de9-97be5676aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:03.756734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43aef5d1-0c38-4f04-9eaf-ff53abe1926b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:03.757465 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Volume 9c0ccd7c-f89b-4ebd-abcd-df5344553309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'volume_size': 1} Nov 13 21:38:03.758402 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] creating volume 'volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:38:03.759382 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:04.795217 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:38:04.797490 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:38:04.798016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43aef5d1-0c38-4f04-9eaf-ff53abe1926b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:04.800130 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c8796e-749e-452e-afe1-33aecc7c3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:04.888319 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309 (9c0ccd7c-f89b-4ebd-abcd-df5344553309): created successfully Nov 13 21:38:04.891888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c8796e-749e-452e-afe1-33aecc7c3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:04.894912 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Flow 'volume_create_manager' (8f52296d-1745-4c18-b33e-0160e445d159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:38:04.957966 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-390395f8-2bf5-48b5-9a58-570d78a17292 tempest-AttachVolumeTestJSON-1492305703 None] Created volume successfully. Nov 13 21:38:06.674775 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-f30c9ad3-aa3e-4e56-b949-c8b1873c6601 req-87f6910b-c6eb-4cdd-a95f-9cce56ee5c62 tempest-AttachVolumeTestJSON-1492305703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:38:07.403119 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-f30c9ad3-aa3e-4e56-b949-c8b1873c6601 req-87f6910b-c6eb-4cdd-a95f-9cce56ee5c62 tempest-AttachVolumeTestJSON-1492305703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.728s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:38:07.404303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-f30c9ad3-aa3e-4e56-b949-c8b1873c6601 req-87f6910b-c6eb-4cdd-a95f-9cce56ee5c62 tempest-AttachVolumeTestJSON-1492305703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:38:07.483601 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-f30c9ad3-aa3e-4e56-b949-c8b1873c6601 req-87f6910b-c6eb-4cdd-a95f-9cce56ee5c62 tempest-AttachVolumeTestJSON-1492305703 None] Connection info returned from driver {'name': 'volumes/volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9c0ccd7c-f89b-4ebd-abcd-df5344553309', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '97afa063-eab2-485f-ac48-3942329f1f5a'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:38:07.616246 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-f30c9ad3-aa3e-4e56-b949-c8b1873c6601 req-87f6910b-c6eb-4cdd-a95f-9cce56ee5c62 tempest-AttachVolumeTestJSON-1492305703 None] attachment_update completed successfully. Nov 13 21:38:12.342153 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-d7987a62-1ae4-4a02-8b0e-312147b5f832 req-456a103d-6c53-4469-9926-008125cbfdf4 tempest-AttachVolumeTestJSON-1492305703 None] Terminate volume connection completed successfully. Nov 13 21:38:12.342787 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d7987a62-1ae4-4a02-8b0e-312147b5f832 req-456a103d-6c53-4469-9926-008125cbfdf4 tempest-AttachVolumeTestJSON-1492305703 None] Deleting attachment a8799a2c-5158-4c3e-8150-fd84c04aedb7. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:38:13.874653 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-cfd18400-a58c-41cd-9c2e-e4597e84bf11 req-53ce4d5e-0690-4337-b071-b329a14c7d60 tempest-AttachVolumeTestJSON-1492305703 None] Terminate volume connection completed successfully. Nov 13 21:38:13.875338 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-cfd18400-a58c-41cd-9c2e-e4597e84bf11 req-53ce4d5e-0690-4337-b071-b329a14c7d60 tempest-AttachVolumeTestJSON-1492305703 None] Deleting attachment 97afa063-eab2-485f-ac48-3942329f1f5a. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:38:21.224584 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:38:21.225624 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:21.287696 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:21.331752 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:22.033604 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-9c0ccd7c-f89b-4ebd-abcd-df5344553309-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:38:22.189253 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:22.613819 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:38:22.615325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:38:22.889815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] deleting rbd volume volume-9c0ccd7c-f89b-4ebd-abcd-df5344553309 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:38:31.042829 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Created reservations ['4f12901a-1ffd-4229-b4c0-141365ecaec3', '6cfabe95-78fa-4592-b986-4f03e900b841', '9fe29bcb-d122-4043-bf91-11c21af5f908', '8eef84d4-c042-4c5f-840e-b5ff309cb9c6'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:31.231874 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:31.271736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:31.330625 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:31.336060 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Deleted volume successfully. Nov 13 21:38:31.447740 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2884f76c-9c88-4167-807b-d7329dee8fb3 tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-9c0ccd7c-f89b-4ebd-abcd-df5344553309-delete_volume'" released by "delete_volume" :: held 9.410s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:31.925211 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-43964ce0-242c-4106-857c-b7b27b1766e3-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:38:32.000851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:32.236516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:38:32.237190 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-43964ce0-242c-4106-857c-b7b27b1766e3 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:38:32.579851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] deleting rbd volume volume-43964ce0-242c-4106-857c-b7b27b1766e3 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:38:37.656222 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-ba0ce75d-ee31-439d-98a7-8f7c0114c84c req-34ebe873-8f88-42eb-bbd3-74fa3e88ae1c tempest-TestVolumeBackupRestore-355465777 None] Terminate volume connection completed successfully. Nov 13 21:38:37.657005 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-ba0ce75d-ee31-439d-98a7-8f7c0114c84c req-34ebe873-8f88-42eb-bbd3-74fa3e88ae1c tempest-TestVolumeBackupRestore-355465777 None] Deleting attachment 297302c2-dcb3-4201-a96d-88c4ebbe6300. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:38:38.877254 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Created reservations ['3a57e4fd-55eb-4fe3-8bc0-506a754ce424', '66c2c653-9d6e-437c-a91a-a1596ae24ea3', '272d8722-8fa9-41bb-9aa5-d8306c2253a3', 'ad5c7c63-4d08-44e1-80e1-de6251ea9bae'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:39.049143 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:39.075367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:39.100874 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:39.105734 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Deleted volume successfully. Nov 13 21:38:39.178566 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d4cfb992-daee-4e42-ad54-a43a37a13b11 tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-43964ce0-242c-4106-857c-b7b27b1766e3-delete_volume'" released by "delete_volume" :: held 7.253s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:39.648325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-22af9efd-4c67-49c5-8130-53aa4c6fead3-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:38:39.818921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:40.134017 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:38:40.135165 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Volume volume-22af9efd-4c67-49c5-8130-53aa4c6fead3 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:38:40.271712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] deleting rbd volume volume-22af9efd-4c67-49c5-8130-53aa4c6fead3 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:38:40.296061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-86820b45-ab53-44db-896f-e5f387a2ced9-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:38:40.492569 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:43.496336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Volume volume-86820b45-ab53-44db-896f-e5f387a2ced9 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:38:44.344321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] deleting rbd volume volume-86820b45-ab53-44db-896f-e5f387a2ced9 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:38:44.373318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-410acec1-b74d-4a4c-a7cd-44223533cde2-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:38:44.491045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:47.639439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] deleting rbd volume volume-410acec1-b74d-4a4c-a7cd-44223533cde2 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:38:47.797492 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Created reservations ['7b4db28a-781a-473c-8576-021edf0f447a', 'd0eb238d-562c-48a7-846c-b7da5b3f6aed', '20ab86a4-d2fc-4113-8cda-13595951ded7', '78d2f851-61d1-44fb-9403-10dacd5b925e'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:47.943021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:48.001542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:48.084562 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:48.094981 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Deleted volume successfully. Nov 13 21:38:48.184876 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-480e5f60-dafb-4a63-b0fa-8e2101435f2d tempest-AttachVolumeTestJSON-1492305703 None] Lock "b'cinder-22af9efd-4c67-49c5-8130-53aa4c6fead3-delete_volume'" released by "delete_volume" :: held 8.538s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:55.386641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:38:55.632658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] deleting parent snapshot volume-410acec1-b74d-4a4c-a7cd-44223533cde2.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:38:58.982371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] Created reservations ['52c5fa37-8662-4cb8-b680-27f7d5057731', 'a96d3257-a530-4950-9fe2-f7e651f5ddcf', 'a1244a26-3718-47ac-8def-1ff4d5ebf94f', 'b8f26b2f-7d4e-4cae-8a3a-438ead9cf225'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:59.019970 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:38:59.025190 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:38:59.025190 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:38:59.041574 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Flow 'volume_create_manager' (c9b86f87-054e-4e11-8860-05d3c7bc97c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:38:59.045093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b476992b-80d1-4d7d-b2b1-302e33083aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.051779 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:38:59.065495 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b476992b-80d1-4d7d-b2b1-302e33083aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:38:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-501095035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cca590da-6893-411a-8e80-7ca1690a198f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='408d22c89cec49faa55abfb72b41d117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:38:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:38:57Z,use_quota=True,user_id='0274d9d33cd14c98a6c71192aabb4c33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.068412 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9066ac-5dea-41e1-82ba-10db42b6c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.071297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9066ac-5dea-41e1-82ba-10db42b6c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.073923 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676fe6f2-701b-41a4-b123-a0085fe0148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.077137 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676fe6f2-701b-41a4-b123-a0085fe0148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca590da-6893-411a-8e80-7ca1690a198f', 'volume_name': 'volume-cca590da-6893-411a-8e80-7ca1690a198f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.079659 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e6978c-8968-4e02-ac56-b05490829786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.082439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e6978c-8968-4e02-ac56-b05490829786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.085341 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675bb106-04a7-49cf-891b-deca27ce3162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.086374 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Volume cca590da-6893-411a-8e80-7ca1690a198f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca590da-6893-411a-8e80-7ca1690a198f', 'volume_size': 1} Nov 13 21:38:59.087601 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] creating volume 'volume-cca590da-6893-411a-8e80-7ca1690a198f' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:38:59.089350 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:59.127221 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Created reservations ['5dc775f6-08c8-4f0a-9aff-28c7d2eb6034', 'c0ff206a-3c12-45a8-a062-bdf9d5aa17d0', 'f5793860-3583-4c3a-bdf0-80b435c5b489', '9ccdef70-fc08-44d7-a1f1-38259a25af15'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:38:59.224264 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:59.263025 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:59.306703 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:59.314617 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] Deleted volume successfully. Nov 13 21:38:59.444917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-15635f31-f26d-41c8-820f-5992c0cd08e4 tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-410acec1-b74d-4a4c-a7cd-44223533cde2-delete_volume'" released by "delete_volume" :: held 15.072s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:59.454115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:59.493590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:38:59.536757 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:38:59.541999 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Deleted volume successfully. Nov 13 21:38:59.627786 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e1b9cc40-e527-42ea-9f7e-43eac1aff8cc tempest-TestVolumeBackupRestore-355465777 None] Lock "b'cinder-86820b45-ab53-44db-896f-e5f387a2ced9-delete_volume'" released by "delete_volume" :: held 19.332s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:38:59.734930 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:38:59.736596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:38:59.742696 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (675bb106-04a7-49cf-891b-deca27ce3162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca590da-6893-411a-8e80-7ca1690a198f', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.747549 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773ae6cd-42c5-43db-a2dc-549a7998de61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:38:59.843328 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Volume volume-cca590da-6893-411a-8e80-7ca1690a198f (cca590da-6893-411a-8e80-7ca1690a198f): created successfully Nov 13 21:38:59.845711 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773ae6cd-42c5-43db-a2dc-549a7998de61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:38:59.850061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Flow 'volume_create_manager' (c9b86f87-054e-4e11-8860-05d3c7bc97c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:38:59.946849 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-d20a7bfb-2414-4cba-a0a8-0533d4790fd3 req-aad13903-62b9-4dbd-a000-b6c40d5d6dec tempest-VolumesGetTestJSON-1552555337 None] Created volume successfully. Nov 13 21:39:00.480147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Lock "b'cinder-cca590da-6893-411a-8e80-7ca1690a198f-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:00.636543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:00.808766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:39:00.809311 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Volume volume-cca590da-6893-411a-8e80-7ca1690a198f is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:00.877449 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] deleting rbd volume volume-cca590da-6893-411a-8e80-7ca1690a198f {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:39:04.431634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Created reservations ['42c2cbdf-815c-442b-a4ad-c7f36c7a287d', 'c2241205-248f-40cc-a857-9aad4bc4bc6d', 'b4f5571b-0a44-458a-880c-e85b4892c857', 'e9867aaa-172a-4b49-8b5d-fcaadc154705'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:39:04.603906 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:04.676255 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:04.740231 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:04.753597 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Deleted volume successfully. Nov 13 21:39:04.835596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-970d7170-254a-41f5-96d2-58c1f9e2babf req-735420c7-612c-4161-a927-eadfcc069d17 tempest-VolumesGetTestJSON-1552555337 None] Lock "b'cinder-cca590da-6893-411a-8e80-7ca1690a198f-delete_volume'" released by "delete_volume" :: held 4.356s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:08.598485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:08.603890 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:08.604736 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:08.618262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (b456c62d-b392-4174-b95e-c49ccafeaa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:08.622035 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cc35e5-b90f-47a0-9b0a-ced292498aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:08.629910 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:08.645167 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cc35e5-b90f-47a0-9b0a-ced292498aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-50361817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4090219-7e63-484e-bf5f-f8b1249be7cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eef2e342d003462db9dc150f6a6fd59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:08Z,use_quota=True,user_id='7ed1557617754e87b181818b46994d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:08.647905 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20a5abb-e964-4baf-a85a-60ad80948354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:08.651580 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f20a5abb-e964-4baf-a85a-60ad80948354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:08.654678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cac2dc-752e-4b30-850f-37088b39ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:08.658501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cac2dc-752e-4b30-850f-37088b39ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4090219-7e63-484e-bf5f-f8b1249be7cf', 'volume_name': 'volume-f4090219-7e63-484e-bf5f-f8b1249be7cf', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:08.662437 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3761f5-2dde-4ca8-96af-431a1b768f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:08.665211 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac3761f5-2dde-4ca8-96af-431a1b768f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:08.667597 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb0510-259d-4c6c-bb71-3479451ad3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:08.668569 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Volume f4090219-7e63-484e-bf5f-f8b1249be7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4090219-7e63-484e-bf5f-f8b1249be7cf', 'volume_size': 1} Nov 13 21:39:08.668993 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] creating volume 'volume-f4090219-7e63-484e-bf5f-f8b1249be7cf' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:39:08.670078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:09.446670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:09.447354 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:09.450735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27cb0510-259d-4c6c-bb71-3479451ad3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4090219-7e63-484e-bf5f-f8b1249be7cf', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:09.458309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3661122f-ddd1-4b74-bd8e-e206ea27612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:09.534004 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Volume volume-f4090219-7e63-484e-bf5f-f8b1249be7cf (f4090219-7e63-484e-bf5f-f8b1249be7cf): created successfully Nov 13 21:39:09.535946 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3661122f-ddd1-4b74-bd8e-e206ea27612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:09.539244 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (b456c62d-b392-4174-b95e-c49ccafeaa5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:09.625196 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-005067c4-fbbb-4fa5-8964-ef4c5f1eea8c tempest-VolumesTestJSON-908014512 None] Created volume successfully. Nov 13 21:39:11.651848 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:11.656329 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:11.657307 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:11.676342 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (e7759093-d286-488d-a9b3-3d6d8f416aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:11.680024 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d88375-0164-4082-a071-54939e9f5298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:11.687047 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:11.700111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d88375-0164-4082-a071-54939e9f5298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-696739610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=776604f1-ff36-4953-8bcd-55c8b02c383c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eef2e342d003462db9dc150f6a6fd59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:11Z,use_quota=True,user_id='7ed1557617754e87b181818b46994d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:11.704372 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00bb369-e10e-4681-8fdd-d61bf2d71937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:11.705007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00bb369-e10e-4681-8fdd-d61bf2d71937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:11.707490 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2435179c-aba5-4250-b265-2a01996c8972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:11.709916 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2435179c-aba5-4250-b265-2a01996c8972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776604f1-ff36-4953-8bcd-55c8b02c383c', 'volume_name': 'volume-776604f1-ff36-4953-8bcd-55c8b02c383c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:11.712149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb427b1a-2f4d-48c1-b6b8-8340cd4e8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:11.714415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb427b1a-2f4d-48c1-b6b8-8340cd4e8557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:11.716734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2543cd8-f1fb-414e-952e-ba5e418557f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:11.717489 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Volume 776604f1-ff36-4953-8bcd-55c8b02c383c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776604f1-ff36-4953-8bcd-55c8b02c383c', 'volume_size': 1} Nov 13 21:39:11.717875 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] creating volume 'volume-776604f1-ff36-4953-8bcd-55c8b02c383c' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:39:11.718896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:12.371563 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:12.373214 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:12.376497 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2543cd8-f1fb-414e-952e-ba5e418557f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776604f1-ff36-4953-8bcd-55c8b02c383c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:12.382920 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb75c5e2-7df7-4f08-a40f-eb6b4be71ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:12.471391 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Volume volume-776604f1-ff36-4953-8bcd-55c8b02c383c (776604f1-ff36-4953-8bcd-55c8b02c383c): created successfully Nov 13 21:39:12.475485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb75c5e2-7df7-4f08-a40f-eb6b4be71ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:12.481822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (e7759093-d286-488d-a9b3-3d6d8f416aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:12.562486 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e387ca80-50c9-474b-8825-183b41a24359 tempest-VolumesTestJSON-908014512 None] Created volume successfully. Nov 13 21:39:14.479367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:14.483675 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:14.484391 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:14.497736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (717b97c3-d0f3-4460-9cd8-1382a6bb5192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:14.501368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc24811-6cd9-463a-a16b-6224ae6e6918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:14.507090 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:14.519843 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc24811-6cd9-463a-a16b-6224ae6e6918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1852966079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d30ce16-9514-4260-8653-55f50c9ff483,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='eef2e342d003462db9dc150f6a6fd59c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:14Z,use_quota=True,user_id='7ed1557617754e87b181818b46994d76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:14.522798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce6a26d-6a0f-4f99-b9e8-5fca10a8d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:14.524967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce6a26d-6a0f-4f99-b9e8-5fca10a8d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:14.528360 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58beb1a7-f709-4261-83d1-d4be6eb897a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:14.530608 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58beb1a7-f709-4261-83d1-d4be6eb897a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d30ce16-9514-4260-8653-55f50c9ff483', 'volume_name': 'volume-5d30ce16-9514-4260-8653-55f50c9ff483', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:14.532836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb017c2-89d4-4f1c-8b2c-cb14c3a779e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:14.534866 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb017c2-89d4-4f1c-8b2c-cb14c3a779e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:14.537680 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9d1d56-31e0-4de6-ae89-0af4e2b7c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:14.538464 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Volume 5d30ce16-9514-4260-8653-55f50c9ff483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d30ce16-9514-4260-8653-55f50c9ff483', 'volume_size': 1} Nov 13 21:39:14.538839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] creating volume 'volume-5d30ce16-9514-4260-8653-55f50c9ff483' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:39:14.546359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:15.068379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:15.068802 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:15.070855 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9d1d56-31e0-4de6-ae89-0af4e2b7c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d30ce16-9514-4260-8653-55f50c9ff483', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:15.073100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b080cd2-f7e2-4cfc-b938-8a7f774c850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:15.174050 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Volume volume-5d30ce16-9514-4260-8653-55f50c9ff483 (5d30ce16-9514-4260-8653-55f50c9ff483): created successfully Nov 13 21:39:15.176049 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b080cd2-f7e2-4cfc-b938-8a7f774c850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:15.178957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Flow 'volume_create_manager' (717b97c3-d0f3-4460-9cd8-1382a6bb5192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:15.322786 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b2e41974-e937-4d5b-96ce-556082dad3d4 tempest-VolumesTestJSON-908014512 None] Created volume successfully. Nov 13 21:39:16.617476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-5d30ce16-9514-4260-8653-55f50c9ff483-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:16.824282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:17.008132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:39:17.008518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Volume volume-5d30ce16-9514-4260-8653-55f50c9ff483 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:17.111242 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] deleting rbd volume volume-5d30ce16-9514-4260-8653-55f50c9ff483 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:39:20.803160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Created reservations ['5bfb3dd5-98a6-4dcf-b782-7ce824656eed', '0eeb7f6a-4aaf-4160-b2dd-7d15ac2f6f71', '9353ec02-7d08-4e41-b843-0c20adaf9858', 'd15d2b4a-5cad-4cc7-b0e9-b9e79c9e6836'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:39:20.951933 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:21.003241 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:21.033312 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:21.042911 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Deleted volume successfully. Nov 13 21:39:21.095128 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6ebfe15c-ab94-47ca-aaa9-58bf0de20c00 tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-5d30ce16-9514-4260-8653-55f50c9ff483-delete_volume'" released by "delete_volume" :: held 4.481s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:21.222370 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:39:21.223485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:21.260641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:21.297836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:22.311183 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-776604f1-ff36-4953-8bcd-55c8b02c383c-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:22.410105 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:22.545263 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:39:22.545694 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Volume volume-776604f1-ff36-4953-8bcd-55c8b02c383c is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:22.614362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] deleting rbd volume volume-776604f1-ff36-4953-8bcd-55c8b02c383c {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:39:26.185482 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Created reservations ['c233423a-f0f5-4329-8476-c83fefb2f58a', 'f5281982-d702-4428-8f4f-25b6045eab49', '71e65174-e8a3-4346-86ff-ecc5beb4798b', '0bd2fc95-1630-4f0c-a09e-346b70f3668c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:39:26.357444 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:26.414407 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:26.487434 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:26.492151 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Deleted volume successfully. Nov 13 21:39:26.581436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-e6b140de-900f-47f2-b0b2-34ee44b2b09d tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-776604f1-ff36-4953-8bcd-55c8b02c383c-delete_volume'" released by "delete_volume" :: held 4.271s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:26.879947 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-f4090219-7e63-484e-bf5f-f8b1249be7cf-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:26.997829 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:27.179491 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:39:27.180668 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Volume volume-f4090219-7e63-484e-bf5f-f8b1249be7cf is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:27.261029 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] deleting rbd volume volume-f4090219-7e63-484e-bf5f-f8b1249be7cf {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:39:30.471363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Created reservations ['d5c62c54-e0c0-410b-8be2-e323a66de2e1', '30330ca3-e898-4dde-bb31-f424b63cbe37', 'cf1f1567-7e86-4fb1-a27b-ab503edc3bbb', 'fe7d4b07-be60-445e-871f-a425b7514803'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:39:30.677336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:30.739576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:30.795272 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:30.801718 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Deleted volume successfully. Nov 13 21:39:30.881588 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3426e1c6-9fb9-4001-9a6e-395ae62ac293 tempest-VolumesTestJSON-908014512 None] Lock "b'cinder-f4090219-7e63-484e-bf5f-f8b1249be7cf-delete_volume'" released by "delete_volume" :: held 4.002s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:36.330288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:36.333681 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:36.337562 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:36.347225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (535f8b09-801e-42be-ba01-48ef45f3e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:36.351218 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0105ca73-42ab-4e57-94d2-776951298bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.358155 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:36.371195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0105ca73-42ab-4e57-94d2-776951298bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2014955340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b2b8e3e9-3406-4383-b2c0-ff348abfbf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae928d75cc4e4d88c3e99de8f45af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:36Z,use_quota=True,user_id='007b4e8c84ec462b9c96ab9ac85f3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.373845 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cf3bd2-2722-4186-ad09-f10d1cd1ae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.375911 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96cf3bd2-2722-4186-ad09-f10d1cd1ae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.378719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca38dbd4-1159-4716-bbe2-c0d0e103ea11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.412923 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:36.418773 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:36.419416 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:36.436943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Flow 'volume_create_manager' (30f043fc-813f-421e-b3f1-6318b57891e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:36.440364 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c2617f-d9fe-4ae9-847f-9d90602d37ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.449873 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:36.480602 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c2617f-d9fe-4ae9-847f-9d90602d37ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-991884671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=79ff4533-1a15-4480-aff9-29bdf6666172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a29eebb7727f492c9a059de8038b9a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:36Z,use_quota=True,user_id='d4d2b7b9b70947b1bbc5428a4e6ade2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.483270 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53eec346-9cef-4fe4-9851-682d7e26a015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.485487 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53eec346-9cef-4fe4-9851-682d7e26a015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.488958 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1e96fd-346a-467f-8f60-bf4a56ea828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.491479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1e96fd-346a-467f-8f60-bf4a56ea828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ff4533-1a15-4480-aff9-29bdf6666172', 'volume_name': 'volume-79ff4533-1a15-4480-aff9-29bdf6666172', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.494236 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b93ffb4-f732-498c-9c01-6176562e4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.502387 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b93ffb4-f732-498c-9c01-6176562e4062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.509302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff364154-b0ec-4445-a0c3-51d387edffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.510462 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Volume 79ff4533-1a15-4480-aff9-29bdf6666172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ff4533-1a15-4480-aff9-29bdf6666172', 'volume_size': 1} Nov 13 21:39:36.511690 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] creating volume 'volume-79ff4533-1a15-4480-aff9-29bdf6666172' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:39:36.513190 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:36.645956 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca38dbd4-1159-4716-bbe2-c0d0e103ea11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b2b8e3e9-3406-4383-b2c0-ff348abfbf13', 'volume_name': 'volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.648555 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d25382-6742-4d11-9a98-94158ccdb474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.650921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d25382-6742-4d11-9a98-94158ccdb474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:36.653733 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ea7df3-23be-482f-9dc8-30af2df771a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:36.654778 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Volume b2b8e3e9-3406-4383-b2c0-ff348abfbf13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:39:36.655367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Cloning b2b8e3e9-3406-4383-b2c0-ff348abfbf13 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:39:36.668232 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:36.746925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 39, 36, 673722)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:39:36.747519 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:39:36.748179 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:39:36.754384 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.089s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:36.755526 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:39:36.767098 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 39, 36, 762492)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:39:36.768224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:39:36.770318 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:39:36.783879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:37.164836 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] creating snapshot='volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:39:39.180543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13.clone_snap' to 'volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:39:39.196107 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:39.196300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:39.198768 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff364154-b0ec-4445-a0c3-51d387edffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ff4533-1a15-4480-aff9-29bdf6666172', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:39.201330 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e0b008-d218-4e3e-8716-9c63c482f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:39.318483 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Volume volume-79ff4533-1a15-4480-aff9-29bdf6666172 (79ff4533-1a15-4480-aff9-29bdf6666172): created successfully Nov 13 21:39:39.319308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e0b008-d218-4e3e-8716-9c63c482f113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:39.322597 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Flow 'volume_create_manager' (30f043fc-813f-421e-b3f1-6318b57891e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:39.391689 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3c5e581a-a2a4-455c-9fd0-e1a029412cde tempest-VolumesServicesTestJSON-440947024 None] Created volume successfully. Nov 13 21:39:40.194629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:40.195387 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:40.195756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:40.569992 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:39:40.570834 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Marking volume b2b8e3e9-3406-4383-b2c0-ff348abfbf13 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:39:40.631203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to b2b8e3e9-3406-4383-b2c0-ff348abfbf13. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:39:40.631773 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Creating volume glance metadata for volume b2b8e3e9-3406-4383-b2c0-ff348abfbf13 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:39:40.701705 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Lock "b'cinder-79ff4533-1a15-4480-aff9-29bdf6666172-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:40.770149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3ea7df3-23be-482f-9dc8-30af2df771a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:40.772327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d2169-55ff-4726-a743-917bd87f193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:40.802719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:40.910775 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:39:40.911280 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Volume volume-79ff4533-1a15-4480-aff9-29bdf6666172 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:39:41.026317 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] deleting rbd volume volume-79ff4533-1a15-4480-aff9-29bdf6666172 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:39:41.028454 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Volume volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13 (b2b8e3e9-3406-4383-b2c0-ff348abfbf13): created successfully Nov 13 21:39:41.031476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1d2169-55ff-4726-a743-917bd87f193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:41.038610 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (535f8b09-801e-42be-ba01-48ef45f3e44f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:41.122142 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8d9cf1d5-b4e1-4770-96df-1c9f12e832be tempest-TestVolumeBootPattern-210846747 None] Created volume successfully. Nov 13 21:39:42.041945 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cb24c477-c94a-474f-8203-9942aca4e33e tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:44.762566 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Created reservations ['39016be7-e513-4ac7-8f49-865bf7562a23', '4125d0cc-aead-4024-96a8-ef1b79a963a8', '0e18b66c-d666-4155-9421-0c4276e6584d', '464c70e3-85f9-4bc3-ad53-75170128bf45'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:39:45.031644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:45.053694 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:45.077479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:39:45.081821 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Deleted volume successfully. Nov 13 21:39:45.153488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eb35d90e-0884-48a7-8096-0e28df5c47d3 tempest-VolumesServicesTestJSON-440947024 None] Lock "b'cinder-79ff4533-1a15-4480-aff9-29bdf6666172-delete_volume'" released by "delete_volume" :: held 4.452s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:39:45.413723 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cb24c477-c94a-474f-8203-9942aca4e33e tempest-TestVolumeBootPattern-210846747 None] Create snapshot completed successfully Nov 13 21:39:51.798637 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:51.805461 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:51.806172 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:51.832632 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Flow 'volume_create_manager' (202b3998-b7f6-4596-95ec-82034a899e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:51.842044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73f0e95-e837-42a4-9c33-a3bf6e319f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:51.849035 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:51.862835 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73f0e95-e837-42a4-9c33-a3bf6e319f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1435536524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68d1a5a2-52c2-49f5-8446-490474b81662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0b5ccd9d166433f968f37381bda2e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:52Z,use_quota=True,user_id='6c6534fdf8b84151bdb01884bf569eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:51.865460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1067cea4-e1ff-4c91-8154-c122f62f3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:51.867545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1067cea4-e1ff-4c91-8154-c122f62f3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:51.870348 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf33c36-71a5-4062-9c8f-32af129e575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:51.872578 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaf33c36-71a5-4062-9c8f-32af129e575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d1a5a2-52c2-49f5-8446-490474b81662', 'volume_name': 'volume-68d1a5a2-52c2-49f5-8446-490474b81662', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:51.874957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461cd1d8-615c-43f0-b670-f63909283df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:51.877076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (461cd1d8-615c-43f0-b670-f63909283df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:51.879533 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af0d41-c7d2-4c6b-8f19-3e1bfbd184d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:51.880343 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Volume 68d1a5a2-52c2-49f5-8446-490474b81662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d1a5a2-52c2-49f5-8446-490474b81662', 'volume_size': 1} Nov 13 21:39:51.880747 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] creating volume 'volume-68d1a5a2-52c2-49f5-8446-490474b81662' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:39:51.882088 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:52.141590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:39:52.144881 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:39:52.145323 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:39:52.165985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (f1675a5f-1de7-46c4-a44d-6819ec8fb8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:52.169111 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0916ff71-0234-4ab9-994d-a4043ae770d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.174895 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:39:52.187081 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0916ff71-0234-4ab9-994d-a4043ae770d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:39:51Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=641abdae-852f-4dbd-918c-2091b3e214f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae928d75cc4e4d88c3e99de8f45af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8f5972f6-506f-4ba4-a160-af02d810be14,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:39:52Z,use_quota=True,user_id='007b4e8c84ec462b9c96ab9ac85f3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.189727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4df07d-b6bd-4741-8a95-1b0aeb5a65a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.191771 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a4df07d-b6bd-4741-8a95-1b0aeb5a65a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.194097 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83331951-d722-438d-8a6a-89278396ffab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.196790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83331951-d722-438d-8a6a-89278396ffab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '641abdae-852f-4dbd-918c-2091b3e214f6', 'volume_name': 'volume-641abdae-852f-4dbd-918c-2091b3e214f6', 'volume_size': 1, 'snapshot_id': '8f5972f6-506f-4ba4-a160-af02d810be14'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.199019 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3160ec-a8b8-41f9-a5d0-c6d4b514fdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.201098 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3160ec-a8b8-41f9-a5d0-c6d4b514fdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.204943 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b489f66-0c99-414f-84a1-d0da41d59649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.204943 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Volume 641abdae-852f-4dbd-918c-2091b3e214f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-641abdae-852f-4dbd-918c-2091b3e214f6', 'volume_size': 1, 'snapshot_id': '8f5972f6-506f-4ba4-a160-af02d810be14'} Nov 13 21:39:52.221510 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] cloning volumes/volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13@snapshot-8f5972f6-506f-4ba4-a160-af02d810be14 to volume-641abdae-852f-4dbd-918c-2091b3e214f6 {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:39:52.222411 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:52.330769 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:52.534683 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:52.535393 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:52.537805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39af0d41-c7d2-4c6b-8f19-3e1bfbd184d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d1a5a2-52c2-49f5-8446-490474b81662', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.540719 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8eeab6-8735-418e-9453-204960ada32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:52.648846 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Volume volume-68d1a5a2-52c2-49f5-8446-490474b81662 (68d1a5a2-52c2-49f5-8446-490474b81662): created successfully Nov 13 21:39:52.651525 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8eeab6-8735-418e-9453-204960ada32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:52.655989 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Flow 'volume_create_manager' (202b3998-b7f6-4596-95ec-82034a899e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:52.737712 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-da04ebd7-75d5-42c2-84fd-20829e760669 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Created volume successfully. Nov 13 21:39:53.608252 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:39:53.608894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:39:53.638383 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Marking volume 641abdae-852f-4dbd-918c-2091b3e214f6 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:39:53.730012 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Copying metadata from snapshot 8f5972f6-506f-4ba4-a160-af02d810be14 to 641abdae-852f-4dbd-918c-2091b3e214f6. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 13 21:39:53.952453 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b489f66-0c99-414f-84a1-d0da41d59649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641abdae-852f-4dbd-918c-2091b3e214f6', 'volume_size': 1, 'snapshot_id': '8f5972f6-506f-4ba4-a160-af02d810be14'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:53.954885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674067e7-865b-45ac-a264-046fb5264245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:39:54.054240 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Volume volume-641abdae-852f-4dbd-918c-2091b3e214f6 (641abdae-852f-4dbd-918c-2091b3e214f6): created successfully Nov 13 21:39:54.056482 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674067e7-865b-45ac-a264-046fb5264245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:39:54.060085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (f1675a5f-1de7-46c4-a44d-6819ec8fb8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:39:54.168115 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-844b63ed-f1b7-45a0-814b-cdd225fbe521 tempest-TestVolumeBootPattern-210846747 None] Created volume successfully. Nov 13 21:39:54.352074 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ba225daa-6bb2-498e-81d1-337a8a86572a tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:39:55.339881 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-cd6a0d18-3c82-44c3-ada8-193244db7ffa tempest-TestVolumeBootPattern-210846747 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:39:56.015956 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-cd6a0d18-3c82-44c3-ada8-193244db7ffa tempest-TestVolumeBootPattern-210846747 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:39:56.016919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-cd6a0d18-3c82-44c3-ada8-193244db7ffa tempest-TestVolumeBootPattern-210846747 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-641abdae-852f-4dbd-918c-2091b3e214f6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '641abdae-852f-4dbd-918c-2091b3e214f6', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:39:56.226229 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-cd6a0d18-3c82-44c3-ada8-193244db7ffa tempest-TestVolumeBootPattern-210846747 None] Connection info returned from driver {'name': 'volumes/volume-641abdae-852f-4dbd-918c-2091b3e214f6', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '641abdae-852f-4dbd-918c-2091b3e214f6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '231ab386-29f6-45c6-afe3-a7363c43cc20'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:39:56.361688 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-576acccf-0a5e-446b-a9e3-4ab63d910800 req-cd6a0d18-3c82-44c3-ada8-193244db7ffa tempest-TestVolumeBootPattern-210846747 None] attachment_update completed successfully. Nov 13 21:39:56.365163 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ba225daa-6bb2-498e-81d1-337a8a86572a tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Create snapshot completed successfully Nov 13 21:39:58.184546 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-097a4e1f-62d8-43cb-b681-f28f50e7e6f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Lock "b'cinder-08e30412-9e4c-4293-8496-b26acc014230-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.033s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:39:58.186798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-097a4e1f-62d8-43cb-b681-f28f50e7e6f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:01.174579 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-097a4e1f-62d8-43cb-b681-f28f50e7e6f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Created reservations ['f9029a80-552b-4847-834a-2480dd832f29', '616223fc-2d87-44ab-a039-7999b0d4edd0', '3742ca02-f62c-4ab3-882c-e53dc2c17f15', '71c5344a-c902-4719-9c5c-a60ecee39f80'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:01.379633 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-097a4e1f-62d8-43cb-b681-f28f50e7e6f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Delete snapshot completed successfully. Nov 13 21:40:01.389791 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-097a4e1f-62d8-43cb-b681-f28f50e7e6f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Lock "b'cinder-08e30412-9e4c-4293-8496-b26acc014230-delete_snapshot'" released by "delete_snapshot" :: held 3.205s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:02.492529 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Lock "b'cinder-68d1a5a2-52c2-49f5-8446-490474b81662-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:02.613422 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:02.796492 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:02.797021 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Volume volume-68d1a5a2-52c2-49f5-8446-490474b81662 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:03.054546 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] deleting rbd volume volume-68d1a5a2-52c2-49f5-8446-490474b81662 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:05.147118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:05.150904 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:05.151382 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:05.164067 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Flow 'volume_create_manager' (501e180e-4411-430b-94fd-b99c77ece9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:05.167239 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2ba257-57c3-4fb6-be0b-97bcec59a114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.174133 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:05.186715 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2ba257-57c3-4fb6-be0b-97bcec59a114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2090740794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=98216a8b-6c82-4882-a530-76e7f264792b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a05f9edb4b21428da5a91d1aa9133c93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:05Z,use_quota=True,user_id='e009e5c78d22425c892de2b855026c17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(127d18c7-dbb2-4191-80f4-b0b8136cacbd),volume_type_id=127d18c7-dbb2-4191-80f4-b0b8136cacbd)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.192460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f45fac-c5ac-4861-bb14-05dc1216d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.192460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f45fac-c5ac-4861-bb14-05dc1216d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.194005 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22219bee-7186-417b-8425-f23ec616b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.196842 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22219bee-7186-417b-8425-f23ec616b453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98216a8b-6c82-4882-a530-76e7f264792b', 'volume_name': 'volume-98216a8b-6c82-4882-a530-76e7f264792b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.199127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca320dae-c452-446d-a8ae-f97565200213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.201160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca320dae-c452-446d-a8ae-f97565200213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.203281 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cff6db3-7654-4afe-80a4-260c44403521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.204151 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Volume 98216a8b-6c82-4882-a530-76e7f264792b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98216a8b-6c82-4882-a530-76e7f264792b', 'volume_size': 1} Nov 13 21:40:05.204448 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] creating volume 'volume-98216a8b-6c82-4882-a530-76e7f264792b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:40:05.205495 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:05.862730 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] extra_specs: {} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:05.863108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] extra_specs: {} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:05.865097 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cff6db3-7654-4afe-80a4-260c44403521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98216a8b-6c82-4882-a530-76e7f264792b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.867213 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ede7d-ffc0-4dd4-ae11-ce0a796d4f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:05.973244 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Volume volume-98216a8b-6c82-4882-a530-76e7f264792b (98216a8b-6c82-4882-a530-76e7f264792b): created successfully Nov 13 21:40:05.973244 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd6ede7d-ffc0-4dd4-ae11-ce0a796d4f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:05.973244 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Flow 'volume_create_manager' (501e180e-4411-430b-94fd-b99c77ece9be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:06.054045 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-41f014f7-116f-477b-8956-d6714c6d0bfc tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Created volume successfully. Nov 13 21:40:06.962527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Created reservations ['42c7af4b-9821-4f79-9e77-8bf86d1ba19c', 'de0aa2cc-d123-4fae-b409-7262d7020baa', 'e87be704-6210-4c82-8649-7691d1bf0b33', 'e52df8df-86a8-443c-acc0-86695cc77f8c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:07.099818 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:07.122872 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:07.145371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:07.150697 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Deleted volume successfully. Nov 13 21:40:07.247152 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0651ef04-54d1-43a4-becd-e7deb6943255 tempest-VolumeSnapshotQuotasNegativeTestJSON-1564180415 None] Lock "b'cinder-68d1a5a2-52c2-49f5-8446-490474b81662-delete_volume'" released by "delete_volume" :: held 4.755s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:07.864263 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6d4eb2db-ed96-4283-8275-f25eeed056d5 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:07.911265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6d4eb2db-ed96-4283-8275-f25eeed056d5 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:07.950426 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-6d4eb2db-ed96-4283-8275-f25eeed056d5 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:07.954661 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6d4eb2db-ed96-4283-8275-f25eeed056d5 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Retype volume completed successfully. Nov 13 21:40:08.874874 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-135dd790-4f91-41b7-973d-28095e5a4537 req-0c0af96c-ccb2-4c52-adcc-c2cdd118302d tempest-TestVolumeBootPattern-210846747 None] Terminate volume connection completed successfully. Nov 13 21:40:08.875616 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-135dd790-4f91-41b7-973d-28095e5a4537 req-0c0af96c-ccb2-4c52-adcc-c2cdd118302d tempest-TestVolumeBootPattern-210846747 None] Deleting attachment 231ab386-29f6-45c6-afe3-a7363c43cc20. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:40:09.018854 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Lock "b'cinder-98216a8b-6c82-4882-a530-76e7f264792b-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:09.173697 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:09.441967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:09.442678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Volume volume-98216a8b-6c82-4882-a530-76e7f264792b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:09.522527 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] deleting rbd volume volume-98216a8b-6c82-4882-a530-76e7f264792b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:09.542283 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-641abdae-852f-4dbd-918c-2091b3e214f6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:09.738531 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:10.150702 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:10.487206 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] deleting rbd volume volume-641abdae-852f-4dbd-918c-2091b3e214f6 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:15.810805 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:40:15.814669 ncdv-master-1 cinder-volume[129109]: WARNING cinder.quota [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 13 21:40:15.916908 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Created reservations ['2a71b6ff-1ff4-4a9e-9e9b-6dc014ccb469', '0fda85fe-7903-4ade-8e67-79d0918026dc', '1c059492-5766-43ac-ab61-25f95f348655', '225a3fb8-35ba-4ff1-a216-d0aacb7d70d8'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:16.107145 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:16.148548 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:16.190239 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:16.194756 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Deleted volume successfully. Nov 13 21:40:16.293578 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-eff155f7-081a-4922-bb2d-9ce8d7214796 tempest-VolumeRetypeWithoutMigrationTest-402275601 None] Lock "b'cinder-98216a8b-6c82-4882-a530-76e7f264792b-delete_volume'" released by "delete_volume" :: held 7.275s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:16.488374 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] Created reservations ['561ba1f2-7405-473f-81b4-9a05684bb8dd', '7de8fcb1-d7e6-4fd0-9d6a-4560e777ba3a', 'c7546a6e-d7d0-4af8-982f-66334e67964e', '9ac11821-fcc2-4ae5-a8f7-f90d39d4e6c1'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:16.672374 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:16.723598 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:16.771215 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:16.778787 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] Deleted volume successfully. Nov 13 21:40:16.938101 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-135dd790-4f91-41b7-973d-28095e5a4537 req-7fff5566-b9b6-4766-8caa-e53224dd214c tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-641abdae-852f-4dbd-918c-2091b3e214f6-delete_volume'" released by "delete_volume" :: held 7.396s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:17.801315 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f378884b-0d17-4866-ae52-df570e50fd2e tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-8f5972f6-506f-4ba4-a160-af02d810be14-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.013s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:17.803158 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f378884b-0d17-4866-ae52-df570e50fd2e tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:18.220907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:18.224394 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:18.224864 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:18.237014 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Flow 'volume_create_manager' (aecebcf4-fcd4-43f5-aa3e-4374301ff15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:18.240064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e003f8-87d5-49ae-99a2-947f601d12aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:18.245962 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:18.258833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6e003f8-87d5-49ae-99a2-947f601d12aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1666221148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=42dc65e5-523c-4fba-b62b-eb861b574dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f88da6479ffa4018a6d78df172a2c648',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:18Z,use_quota=True,user_id='fb2eead94efe4b4b995cc13f3c0c0b07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:18.261560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae221d-bc28-424a-8523-10cab6d05d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:18.263641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dae221d-bc28-424a-8523-10cab6d05d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:18.265999 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a71058-1c3a-4554-a800-5c94be45586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:18.354499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15a71058-1c3a-4554-a800-5c94be45586e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42dc65e5-523c-4fba-b62b-eb861b574dd2', 'volume_name': 'volume-42dc65e5-523c-4fba-b62b-eb861b574dd2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:18.357163 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f566085e-92bb-463b-afaf-75cecbd7e836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:18.359428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f566085e-92bb-463b-afaf-75cecbd7e836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:18.361845 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5487fa-c4a4-4b06-87b1-6aeaccb8933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:18.362924 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Volume 42dc65e5-523c-4fba-b62b-eb861b574dd2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42dc65e5-523c-4fba-b62b-eb861b574dd2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:40:18.363710 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Cloning 42dc65e5-523c-4fba-b62b-eb861b574dd2 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:40:18.373461 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:18.465146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 40, 18, 377581)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:40:18.465577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:40:18.465979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:40:18.470672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.097s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:18.471697 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:40:18.477532 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 40, 18, 475138)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:40:18.478233 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:40:18.478687 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:40:18.490113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:18.682439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] creating snapshot='volume-42dc65e5-523c-4fba-b62b-eb861b574dd2.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:40:21.317443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-42dc65e5-523c-4fba-b62b-eb861b574dd2.clone_snap' to 'volume-42dc65e5-523c-4fba-b62b-eb861b574dd2' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:40:21.320726 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:40:21.321463 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:21.407585 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:21.447643 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:22.105662 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f378884b-0d17-4866-ae52-df570e50fd2e tempest-TestVolumeBootPattern-210846747 None] Created reservations ['73a1ac00-31ba-434e-bf7d-41ba770d6e85', '4814f936-d6c7-43f7-b5ea-7ca6473b338f', '784d3273-cf22-448a-8d6d-6c2369abed60', 'f702dd45-6a5d-4254-b36f-59c2428520eb'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:22.425389 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f378884b-0d17-4866-ae52-df570e50fd2e tempest-TestVolumeBootPattern-210846747 None] Delete snapshot completed successfully. Nov 13 21:40:22.432375 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f378884b-0d17-4866-ae52-df570e50fd2e tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-8f5972f6-506f-4ba4-a160-af02d810be14-delete_snapshot'" released by "delete_snapshot" :: held 4.629s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:22.631419 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:22.635404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:22.635404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:22.911287 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:40:22.912140 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Marking volume 42dc65e5-523c-4fba-b62b-eb861b574dd2 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:40:22.957204 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 42dc65e5-523c-4fba-b62b-eb861b574dd2. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:40:22.957560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Creating volume glance metadata for volume 42dc65e5-523c-4fba-b62b-eb861b574dd2 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:40:23.067491 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5487fa-c4a4-4b06-87b1-6aeaccb8933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42dc65e5-523c-4fba-b62b-eb861b574dd2', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:23.069644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed1cee-4e86-43b9-aec9-447c0e49d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:23.133734 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Volume volume-42dc65e5-523c-4fba-b62b-eb861b574dd2 (42dc65e5-523c-4fba-b62b-eb861b574dd2): created successfully Nov 13 21:40:23.135774 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ed1cee-4e86-43b9-aec9-447c0e49d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:23.139560 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Flow 'volume_create_manager' (aecebcf4-fcd4-43f5-aa3e-4374301ff15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:23.172151 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-b2b8e3e9-3406-4383-b2c0-ff348abfbf13-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:23.190968 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1d97c750-6a98-4d4a-b701-9878cc6794a9 tempest-VolumesImageMetadata-575000942 None] Created volume successfully. Nov 13 21:40:23.273868 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:23.493975 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:23.655203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] deleting rbd volume volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:23.935799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] Lock "b'cinder-42dc65e5-523c-4fba-b62b-eb861b574dd2-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:24.070039 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:24.419712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:24.632598 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] deleting rbd volume volume-42dc65e5-523c-4fba-b62b-eb861b574dd2 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:27.543101 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:27.546674 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:27.547214 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:27.558641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Flow 'volume_create_manager' (b0ef3a9d-8baa-4e92-a6dc-fa0165bbd796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:27.561822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2812a0-ca7c-4ce3-b4ff-f51f8133c638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:27.567941 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:27.580461 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2812a0-ca7c-4ce3-b4ff-f51f8133c638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1262584326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=984d529a-e861-4b4b-b197-3a49aea6fa14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67a3c9fc55e478db91336788ca6e537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:27Z,use_quota=True,user_id='96720ee728504ef687ee13b93cbdf688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:27.583141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fc56b-25d2-4796-8875-2466a8431d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:27.585354 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd6fc56b-25d2-4796-8875-2466a8431d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:27.588206 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf9f531-3db6-45fa-9960-c1e3b73722ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:27.591399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcf9f531-3db6-45fa-9960-c1e3b73722ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984d529a-e861-4b4b-b197-3a49aea6fa14', 'volume_name': 'volume-984d529a-e861-4b4b-b197-3a49aea6fa14', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:27.593611 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28bf3c1-74de-4195-b7e4-35c24e973fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:27.595669 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28bf3c1-74de-4195-b7e4-35c24e973fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:27.597809 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52e6710-8ae2-40c1-9119-a7a7261e58b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:27.606885 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Volume 984d529a-e861-4b4b-b197-3a49aea6fa14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984d529a-e861-4b4b-b197-3a49aea6fa14', 'volume_size': 1} Nov 13 21:40:27.606885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] creating volume 'volume-984d529a-e861-4b4b-b197-3a49aea6fa14' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:40:27.606885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:28.708421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:28.709094 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:28.710879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a52e6710-8ae2-40c1-9119-a7a7261e58b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984d529a-e861-4b4b-b197-3a49aea6fa14', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:28.713084 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b128d54-15a4-47b2-aded-44b3387b5484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:28.784724 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Volume volume-984d529a-e861-4b4b-b197-3a49aea6fa14 (984d529a-e861-4b4b-b197-3a49aea6fa14): created successfully Nov 13 21:40:28.786682 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b128d54-15a4-47b2-aded-44b3387b5484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:28.790372 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Flow 'volume_create_manager' (b0ef3a9d-8baa-4e92-a6dc-fa0165bbd796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:28.859233 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2559230a-a09c-4cb9-87af-8a121f69aeb2 tempest-VolumesTransfersV355Test-838566192 None] Created volume successfully. Nov 13 21:40:29.277362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:40:29.455520 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] deleting parent snapshot volume-b2b8e3e9-3406-4383-b2c0-ff348abfbf13.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:40:32.550773 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:40:32.683316 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] deleting parent snapshot volume-42dc65e5-523c-4fba-b62b-eb861b574dd2.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:40:35.202109 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-417d01e2-d867-409a-ba0b-b36b7ab97860 tempest-VolumesTransfersV355Test-1433046782 None] Transfer volume completed successfully. Nov 13 21:40:35.306471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] Created reservations ['a5ba0ec7-c784-4f2c-ab75-b429f7f9b462', 'aa9dd3f0-1206-4bcf-89ae-d9bf731b61ff', 'f9c0842b-3e8e-4092-ba4e-d20c6c56e92e', '179591b0-dfe7-4776-8b98-182823cb2779'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:35.314440 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] Created reservations ['ebaf095d-7f71-400f-a165-c0df0e60d268', 'c9bc6c93-8005-4e65-8381-50ff5e874700', 'd5127aed-a23c-4ff2-997f-7da03e5804d5', '30af7dc4-077e-4699-8507-60a6a0328fce'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:35.601919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:35.636328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:35.684614 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:35.699105 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:35.756132 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:35.848741 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:35.906165 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] Deleted volume successfully. Nov 13 21:40:35.920412 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] Deleted volume successfully. Nov 13 21:40:35.991126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-038c6825-4902-43c0-8422-a6b5da806414 tempest-VolumesImageMetadata-575000942 None] Lock "b'cinder-42dc65e5-523c-4fba-b62b-eb861b574dd2-delete_volume'" released by "delete_volume" :: held 12.055s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:35.994028 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-a067fc0c-e2f7-4162-85ea-c3722cb266f1 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-b2b8e3e9-3406-4383-b2c0-ff348abfbf13-delete_volume'" released by "delete_volume" :: held 12.822s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:36.631110 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Lock "b'cinder-984d529a-e861-4b4b-b197-3a49aea6fa14-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:36.760126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:36.923249 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:36.923678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Volume volume-984d529a-e861-4b4b-b197-3a49aea6fa14 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:37.048437 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] deleting rbd volume volume-984d529a-e861-4b4b-b197-3a49aea6fa14 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:37.141654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:37.146671 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:37.147289 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:37.159398 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (a38c0121-e9ec-48a1-933c-164d2da54bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:37.168496 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283dd919-8294-40ce-b4ba-0138980bf64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:37.175918 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:37.217017 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (283dd919-8294-40ce-b4ba-0138980bf64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2056276591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7e246c91-e1e1-481c-bfad-005ee7585c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae928d75cc4e4d88c3e99de8f45af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:37Z,use_quota=True,user_id='007b4e8c84ec462b9c96ab9ac85f3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:37.229263 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbed764-1fbc-4d44-ace4-8060ecaf598f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:37.231434 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbed764-1fbc-4d44-ace4-8060ecaf598f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:37.233833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846ece95-9ce2-4f7f-ae68-99a7dcfc1aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:37.341224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (846ece95-9ce2-4f7f-ae68-99a7dcfc1aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e246c91-e1e1-481c-bfad-005ee7585c4f', 'volume_name': 'volume-7e246c91-e1e1-481c-bfad-005ee7585c4f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:37.343726 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c308cb6-6606-41f3-8146-fa4ff14c91e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:37.345877 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c308cb6-6606-41f3-8146-fa4ff14c91e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:37.348011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c2066a-477f-41e2-bf05-ab827bc02766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:37.348837 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Volume 7e246c91-e1e1-481c-bfad-005ee7585c4f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e246c91-e1e1-481c-bfad-005ee7585c4f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:40:37.349505 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Cloning 7e246c91-e1e1-481c-bfad-005ee7585c4f from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:40:37.359877 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:37.448096 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 40, 37, 363436)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:40:37.448580 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:40:37.449093 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:40:37.454440 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.095s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:37.455278 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:40:37.461353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 40, 37, 458585)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:40:37.461765 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:40:37.462154 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:40:37.473683 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:37.688138 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] creating snapshot='volume-7e246c91-e1e1-481c-bfad-005ee7585c4f.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:40:40.837288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-7e246c91-e1e1-481c-bfad-005ee7585c4f.clone_snap' to 'volume-7e246c91-e1e1-481c-bfad-005ee7585c4f' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:40:40.952376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:40.955923 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:40.956384 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:40.968817 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Flow 'volume_create_manager' (aa363c36-44f8-413d-885f-03a91704fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:40.972929 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ebde6-7af6-4a84-a849-f3344e701ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:40.979803 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:40.992607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289ebde6-7af6-4a84-a849-f3344e701ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1494912344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=8623d80c-b68b-4d0c-a4a2-cd9e81ca139a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44cfcec84c274d4f81aa85e354c55c49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:39Z,use_quota=True,user_id='0f6f2c042141402ebca7011e47d1d798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:40.995167 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd61919f-dcc6-4c19-a7d2-903139749ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:40.997368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd61919f-dcc6-4c19-a7d2-903139749ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:41.006120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee9bce7-6226-4225-9fb4-4584d77e4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:41.006120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee9bce7-6226-4225-9fb4-4584d77e4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8623d80c-b68b-4d0c-a4a2-cd9e81ca139a', 'volume_name': 'volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:41.006120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0606fa-d5e9-4272-9e7a-b0664e354277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:41.006472 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0606fa-d5e9-4272-9e7a-b0664e354277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:41.008840 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b932e-cc88-4512-b738-9c92d18a7509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:41.009696 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Volume 8623d80c-b68b-4d0c-a4a2-cd9e81ca139a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a', 'volume_size': 1} Nov 13 21:40:41.010007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] creating volume 'volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:40:41.011058 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:41.990729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:41.990729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:41.990729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (213b932e-cc88-4512-b738-9c92d18a7509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:41.991950 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d62334-eb2b-4450-a8ff-486e8384ba86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:42.065756 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Volume volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a (8623d80c-b68b-4d0c-a4a2-cd9e81ca139a): created successfully Nov 13 21:40:42.068703 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d62334-eb2b-4450-a8ff-486e8384ba86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:42.073392 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Flow 'volume_create_manager' (aa363c36-44f8-413d-885f-03a91704fb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:42.135240 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-669ce04d-43d9-4b82-8267-cbc7aa818ea7 tempest-VolumesDeleteCascade-1602037236 None] Created volume successfully. Nov 13 21:40:42.299305 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Created reservations ['21c35ac6-869b-4b5a-ac1b-65327f2c2e4b', '16e078af-8d28-4e0b-ab1e-83e24da66c83', 'a4c22499-39e8-4507-9820-1e1aa1ccba0a', 'ed5aff43-639a-4c23-81b3-634480c24578'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:42.441321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:42.442972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:42.443410 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:42.623815 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:40:42.624501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Marking volume 7e246c91-e1e1-481c-bfad-005ee7585c4f as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:40:42.630185 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:42.656059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:42.733630 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:42.738694 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Deleted volume successfully. Nov 13 21:40:42.834640 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-cdf5891f-a071-48d0-b014-dd74bbd19220 tempest-VolumesTransfersV355Test-975871680 None] Lock "b'cinder-984d529a-e861-4b4b-b197-3a49aea6fa14-delete_volume'" released by "delete_volume" :: held 6.204s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:42.847996 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 7e246c91-e1e1-481c-bfad-005ee7585c4f. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:40:42.850879 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Creating volume glance metadata for volume 7e246c91-e1e1-481c-bfad-005ee7585c4f backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:40:42.980327 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c2066a-477f-41e2-bf05-ab827bc02766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e246c91-e1e1-481c-bfad-005ee7585c4f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:42.988976 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa1e6e-30f8-4606-b02b-3d8bde88f3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.082401 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Volume volume-7e246c91-e1e1-481c-bfad-005ee7585c4f (7e246c91-e1e1-481c-bfad-005ee7585c4f): created successfully Nov 13 21:40:43.084414 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8fa1e6e-30f8-4606-b02b-3d8bde88f3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:43.089147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (a38c0121-e9ec-48a1-933c-164d2da54bac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:43.139774 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2de1e6c0-c961-4cda-a030-7a4bcd24478b tempest-TestVolumeBootPattern-210846747 None] Created volume successfully. Nov 13 21:40:43.729044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9dd6f043-cc1b-4a7a-abf9-c3ae3f6b84cd tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:43.925068 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:43.930650 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:43.931311 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:43.944019 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Flow 'volume_create_manager' (2c358792-c71b-4ab4-becd-d8c9358fea9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:43.947859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ab474d-b3a3-4094-8cbe-c844929901df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.954961 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:43.974188 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ab474d-b3a3-4094-8cbe-c844929901df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-658234305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0768ea75-43c9-40fd-a84a-4c79e599880d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67a3c9fc55e478db91336788ca6e537',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:44Z,use_quota=True,user_id='96720ee728504ef687ee13b93cbdf688',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:43.979363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d43b376-149f-4b9a-9f7b-ac73e9a22996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.979559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d43b376-149f-4b9a-9f7b-ac73e9a22996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:43.982091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d9c48d-dead-4e1c-aaf7-f1b203050b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.984366 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d9c48d-dead-4e1c-aaf7-f1b203050b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0768ea75-43c9-40fd-a84a-4c79e599880d', 'volume_name': 'volume-0768ea75-43c9-40fd-a84a-4c79e599880d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:43.986586 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c20de09-52e6-40f9-9faa-0c992cd81962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.988725 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c20de09-52e6-40f9-9faa-0c992cd81962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:43.991059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a171d0-7e8d-40eb-9649-0f3e00194abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:43.991841 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Volume 0768ea75-43c9-40fd-a84a-4c79e599880d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0768ea75-43c9-40fd-a84a-4c79e599880d', 'volume_size': 1} Nov 13 21:40:43.992228 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] creating volume 'volume-0768ea75-43c9-40fd-a84a-4c79e599880d' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:40:43.993232 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:44.914114 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:44.914814 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:44.916493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a171d0-7e8d-40eb-9649-0f3e00194abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0768ea75-43c9-40fd-a84a-4c79e599880d', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:44.918641 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154aba35-6e25-449c-9e13-e275f1cc2862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:44.991460 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Volume volume-0768ea75-43c9-40fd-a84a-4c79e599880d (0768ea75-43c9-40fd-a84a-4c79e599880d): created successfully Nov 13 21:40:44.994205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154aba35-6e25-449c-9e13-e275f1cc2862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:44.997262 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Flow 'volume_create_manager' (2c358792-c71b-4ab4-becd-d8c9358fea9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:45.076287 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0ae956de-76c0-41e7-977f-c1c9c55b57e3 tempest-VolumesTransfersV355Test-838566192 None] Created volume successfully. Nov 13 21:40:46.595728 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Lock "b'cinder-0768ea75-43c9-40fd-a84a-4c79e599880d-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:46.727847 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9dd6f043-cc1b-4a7a-abf9-c3ae3f6b84cd tempest-VolumesDeleteCascade-1602037236 None] Create snapshot completed successfully Nov 13 21:40:46.740446 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:46.922359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:40:46.922963 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Volume volume-0768ea75-43c9-40fd-a84a-4c79e599880d is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:40:47.054367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] deleting rbd volume volume-0768ea75-43c9-40fd-a84a-4c79e599880d {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:40:47.756592 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-32fa8855-97b3-40ad-bdda-66735571361a req-5a290aea-1778-42a4-8e32-fd05b7989cb8 tempest-TestVolumeBootPattern-210846747 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:40:48.236989 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-cd9645e4-a142-46b0-9938-11cf9e05a9e3 tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:48.663005 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-32fa8855-97b3-40ad-bdda-66735571361a req-5a290aea-1778-42a4-8e32-fd05b7989cb8 tempest-TestVolumeBootPattern-210846747 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.906s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:40:48.663681 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-32fa8855-97b3-40ad-bdda-66735571361a req-5a290aea-1778-42a4-8e32-fd05b7989cb8 tempest-TestVolumeBootPattern-210846747 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7e246c91-e1e1-481c-bfad-005ee7585c4f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '7e246c91-e1e1-481c-bfad-005ee7585c4f', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:40:48.807739 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-32fa8855-97b3-40ad-bdda-66735571361a req-5a290aea-1778-42a4-8e32-fd05b7989cb8 tempest-TestVolumeBootPattern-210846747 None] Connection info returned from driver {'name': 'volumes/volume-7e246c91-e1e1-481c-bfad-005ee7585c4f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7e246c91-e1e1-481c-bfad-005ee7585c4f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f9aa29f5-acce-425a-8557-7296daaa68ff'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:40:49.049987 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-32fa8855-97b3-40ad-bdda-66735571361a req-5a290aea-1778-42a4-8e32-fd05b7989cb8 tempest-TestVolumeBootPattern-210846747 None] attachment_update completed successfully. Nov 13 21:40:52.048026 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Created reservations ['37acbf27-620d-4e59-bc48-e5524e1cef30', '3de67f4a-7f19-4a60-b9e7-49258bd43fef', '1865014c-5e6f-4478-b530-a838ea789772', '644b4c97-5509-48ab-918e-d9d61f8cc4c2'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:52.237150 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-cd9645e4-a142-46b0-9938-11cf9e05a9e3 tempest-VolumesDeleteCascade-1602037236 None] Create snapshot completed successfully Nov 13 21:40:52.294522 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:52.334042 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:52.372980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:40:52.377764 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Deleted volume successfully. Nov 13 21:40:52.452078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-31d49f06-5e42-4b56-ac45-d85265b644de tempest-VolumesTransfersV355Test-975871680 None] Lock "b'cinder-0768ea75-43c9-40fd-a84a-4c79e599880d-delete_volume'" released by "delete_volume" :: held 5.856s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:53.638805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:53.772217 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Performing cascade delete. {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Nov 13 21:40:53.791438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-b2f3e050-342d-4921-8259-44997a71feb6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:53.803236 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:56.774138 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Created reservations ['6300b0ad-2fb7-4fbd-a047-7d944da9d6e1', 'c3468e9d-2bf3-411a-b833-c00fb43f2809', 'e2a3bff4-6c7c-4368-946c-8488a9d655b4', 'dc435720-337e-499f-89b0-ea4f65380f27'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:40:57.036665 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Delete snapshot completed successfully. Nov 13 21:40:57.043172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-b2f3e050-342d-4921-8259-44997a71feb6-delete_snapshot'" released by "delete_snapshot" :: held 3.252s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:40:57.056880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-df675aa3-2668-40c5-a7f2-02c8df5b35c2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:40:57.075730 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:58.759095 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:40:58.767069 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:40:58.767069 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:40:58.780501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (9bbf0627-a025-43e6-95af-1e9a7e2522f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:58.783908 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9501fb5c-0995-429b-9b73-506f21c181ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:58.790912 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:40:58.803867 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9501fb5c-0995-429b-9b73-506f21c181ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-587989496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dede95ed8404ed8a864fd9fee5b2946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:40:59Z,use_quota=True,user_id='42f80111073c438cb07df07471461332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:58.806510 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d926ea-74c1-46ea-bae8-6d8bfc1abbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:58.808583 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d926ea-74c1-46ea-bae8-6d8bfc1abbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:58.810925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064db69-ada6-4221-b88e-2ac1b7f2d292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:58.813190 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b064db69-ada6-4221-b88e-2ac1b7f2d292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'volume_name': 'volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:58.815404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbbbd9a-1d2b-4f7a-b103-6594b4065b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:58.817490 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbbbd9a-1d2b-4f7a-b103-6594b4065b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:58.819607 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445cc702-ab64-494c-9295-c9e06b75ea67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:58.820935 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Volume ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'volume_size': 1} Nov 13 21:40:58.823400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] creating volume 'volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:40:58.823400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:40:59.457205 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:40:59.462649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:40:59.466397 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (445cc702-ab64-494c-9295-c9e06b75ea67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:59.473312 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8b1e46-0650-480d-9b72-af2e4f24771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:40:59.608832 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Volume volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522 (ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522): created successfully Nov 13 21:40:59.611645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8b1e46-0650-480d-9b72-af2e4f24771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:40:59.615732 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (9bbf0627-a025-43e6-95af-1e9a7e2522f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:40:59.680198 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-ff813e20-6fe4-4245-a394-d479c9185f07 req-0ccaff72-38d2-4434-8fea-798dbc4d366c tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:00.026675 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3ca4e161-fa28-449e-a586-25139537c316 tempest-VolumesBackupsTest-1116982884 None] Created volume successfully. Nov 13 21:41:00.808572 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Created reservations ['9ccdf4b8-cacb-4bef-9f47-2b05b47f7dad', '74abb17e-daab-41fe-9d51-67bc6d445ddb', '5b6963e8-8c95-4b81-aefd-8a85f7a7c038', '4a059da1-51b4-45f5-bdc4-ff5dd29287a3'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:41:01.099118 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Delete snapshot completed successfully. Nov 13 21:41:01.109859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-df675aa3-2668-40c5-a7f2-02c8df5b35c2-delete_snapshot'" released by "delete_snapshot" :: held 4.048s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:41:01.109859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Snapshots deleted, issuing volume delete {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Nov 13 21:41:01.109859 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:01.333588 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:41:01.334029 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Volume volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:41:01.454075 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] deleting rbd volume volume-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:41:02.585143 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-ff813e20-6fe4-4245-a394-d479c9185f07 req-0ccaff72-38d2-4434-8fea-798dbc4d366c tempest-TestVolumeBootPattern-210846747 None] Create snapshot completed successfully Nov 13 21:41:05.745659 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Created reservations ['12525fc2-69b0-4f64-a6ba-c6570fa874b1', '909fe398-efdf-4dc6-9198-46a08f5819df', '0298ef8e-3b06-489e-a6b8-b054f9686e91', '4337fa84-c460-4bb7-857b-9a78409e08c2'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:41:05.968925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:06.022400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:06.177553 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:41:06.182417 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Deleted volume successfully. Nov 13 21:41:06.290488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-0b012545-d156-475a-a524-1e13557d7c1e tempest-VolumesDeleteCascade-1602037236 None] Lock "b'cinder-8623d80c-b68b-4d0c-a4a2-cd9e81ca139a-delete_volume'" released by "delete_volume" :: held 12.652s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:41:07.884350 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:41:07.913091 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:41:07.913091 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:41:07.938896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (1f9e2df7-5183-4b25-9fed-29ded99580f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:41:07.945766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61dd6ab-b404-4fe4-a366-0a57f3d16551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:07.954189 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:41:07.970128 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b61dd6ab-b404-4fe4-a366-0a57f3d16551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:41:07Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d6bc420-76d6-4367-a9c9-2fc9d1deb4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae928d75cc4e4d88c3e99de8f45af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5acdc2a6-e983-4c55-98f6-d2ba9033e5bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:41:08Z,use_quota=True,user_id='007b4e8c84ec462b9c96ab9ac85f3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:07.973502 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f91d51-3007-47ab-a39f-dc3ec3b08c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:07.976038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f91d51-3007-47ab-a39f-dc3ec3b08c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:07.982479 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b21553b-40a1-4a03-b3a9-058778fa1b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:07.985570 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b21553b-40a1-4a03-b3a9-058778fa1b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'volume_name': 'volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'volume_size': 1, 'snapshot_id': '5acdc2a6-e983-4c55-98f6-d2ba9033e5bd'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:07.987890 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035c424-6dd6-48c0-98a9-b7ebdc1e6f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:07.990391 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2035c424-6dd6-48c0-98a9-b7ebdc1e6f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:07.992841 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ba2adf-b206-477b-af6c-41224f25eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:07.993742 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Volume 5d6bc420-76d6-4367-a9c9-2fc9d1deb4df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'volume_size': 1, 'snapshot_id': '5acdc2a6-e983-4c55-98f6-d2ba9033e5bd'} Nov 13 21:41:08.017881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] cloning volumes/volume-7e246c91-e1e1-481c-bfad-005ee7585c4f@snapshot-5acdc2a6-e983-4c55-98f6-d2ba9033e5bd to volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df {{(pid=129109) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1027}} Nov 13 21:41:08.018828 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:08.106516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:09.264299 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:41:09.265919 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:41:09.309545 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Marking volume 5d6bc420-76d6-4367-a9c9-2fc9d1deb4df as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:41:09.379265 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Copying metadata from snapshot 5acdc2a6-e983-4c55-98f6-d2ba9033e5bd to 5d6bc420-76d6-4367-a9c9-2fc9d1deb4df. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 13 21:41:09.495286 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ba2adf-b206-477b-af6c-41224f25eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'volume_size': 1, 'snapshot_id': '5acdc2a6-e983-4c55-98f6-d2ba9033e5bd'}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:09.497842 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21394329-1655-43cd-aa9f-0ac7ffaeb080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:41:09.581739 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Volume volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df (5d6bc420-76d6-4367-a9c9-2fc9d1deb4df): created successfully Nov 13 21:41:09.584928 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21394329-1655-43cd-aa9f-0ac7ffaeb080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:41:09.588119 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (1f9e2df7-5183-4b25-9fed-29ded99580f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:41:09.662482 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-0bb5254b-000c-43ff-a436-065735b81bc4 tempest-TestVolumeBootPattern-210846747 None] Created volume successfully. Nov 13 21:41:11.054985 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-820f9cb0-a465-4841-b916-20e184d54f00 req-2960c010-527e-4f59-a7de-db788e3ce8cf tempest-TestVolumeBootPattern-210846747 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:41:11.841392 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-820f9cb0-a465-4841-b916-20e184d54f00 req-2960c010-527e-4f59-a7de-db788e3ce8cf tempest-TestVolumeBootPattern-210846747 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.786s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:41:11.843275 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-820f9cb0-a465-4841-b916-20e184d54f00 req-2960c010-527e-4f59-a7de-db788e3ce8cf tempest-TestVolumeBootPattern-210846747 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:41:11.956542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-2960c010-527e-4f59-a7de-db788e3ce8cf tempest-TestVolumeBootPattern-210846747 None] Connection info returned from driver {'name': 'volumes/volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5d6bc420-76d6-4367-a9c9-2fc9d1deb4df', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '58d53290-8561-47a4-9c8c-d5c2056dd89d'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:41:12.093450 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-820f9cb0-a465-4841-b916-20e184d54f00 req-2960c010-527e-4f59-a7de-db788e3ce8cf tempest-TestVolumeBootPattern-210846747 None] attachment_update completed successfully. Nov 13 21:41:18.858790 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-70592ac0-dd6f-4923-a874-8098add7b12e req-2fdf8f06-019f-4445-9aac-6bd48af36fd8 tempest-VolumesBackupsTest-1116982884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:41:19.601731 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-70592ac0-dd6f-4923-a874-8098add7b12e req-2fdf8f06-019f-4445-9aac-6bd48af36fd8 tempest-VolumesBackupsTest-1116982884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.743s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:41:19.602863 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-70592ac0-dd6f-4923-a874-8098add7b12e req-2fdf8f06-019f-4445-9aac-6bd48af36fd8 tempest-VolumesBackupsTest-1116982884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:41:19.694147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-70592ac0-dd6f-4923-a874-8098add7b12e req-2fdf8f06-019f-4445-9aac-6bd48af36fd8 tempest-VolumesBackupsTest-1116982884 None] Connection info returned from driver {'name': 'volumes/volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4dc54787-63a7-4b29-b5e1-b74fe5b2d6ba'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:41:19.847412 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-70592ac0-dd6f-4923-a874-8098add7b12e req-2fdf8f06-019f-4445-9aac-6bd48af36fd8 tempest-VolumesBackupsTest-1116982884 None] attachment_update completed successfully. Nov 13 21:41:21.316878 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:41:21.320275 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:21.359725 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:21.415353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:41:24.282238 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:41:25.344876 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.062s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:41:25.345883 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:41:25.376183 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] Initialize volume connection completed successfully. Nov 13 21:41:27.399643 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-180e5dcc-5118-4344-bb0b-c9d5c05416b7 tempest-TestVolumeBootPattern-210846747 None] Terminate volume connection completed successfully. Nov 13 21:41:27.400806 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-180e5dcc-5118-4344-bb0b-c9d5c05416b7 tempest-TestVolumeBootPattern-210846747 None] Deleting attachment 58d53290-8561-47a4-9c8c-d5c2056dd89d. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:41:27.989038 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:41:28.109871 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:28.607493 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:41:29.094549 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] deleting rbd volume volume-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:41:33.782015 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] Terminate volume connection completed successfully. Nov 13 21:41:33.801870 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-288d7269-fbcc-44c0-9df9-71fcc37dd610 tempest-VolumesBackupsTest-1116982884 None] Remove volume export completed successfully. Nov 13 21:41:38.294782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] Created reservations ['de126541-b115-4f37-a498-44f5bdcf5a8a', '8f355db3-323d-4e61-9e72-64ce9238be24', '52a11a06-9c71-4446-830f-14cc665ca253', 'de438e07-4d34-4c9c-8d25-25456f9209a0'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:41:38.494364 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:38.531977 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:38.593040 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:41:38.605770 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] Deleted volume successfully. Nov 13 21:41:38.668000 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-3f503f81-47d3-459a-86f5-9f9b62fb548b req-6611de2c-1a39-40f1-b956-023dd5b424ad tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-5d6bc420-76d6-4367-a9c9-2fc9d1deb4df-delete_volume'" released by "delete_volume" :: held 10.680s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:41:38.706955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-de2c538d-d91e-4a06-9de8-550a3ccd43a1 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-5acdc2a6-e983-4c55-98f6-d2ba9033e5bd-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:41:38.708643 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-de2c538d-d91e-4a06-9de8-550a3ccd43a1 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:46.823370 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-fa925586-8f3c-4470-8b55-b47e9cc11d15 req-08560513-2b6a-4f4b-a381-657736498c6c tempest-VolumesBackupsTest-1116982884 None] Terminate volume connection completed successfully. Nov 13 21:41:46.829561 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-fa925586-8f3c-4470-8b55-b47e9cc11d15 req-08560513-2b6a-4f4b-a381-657736498c6c tempest-VolumesBackupsTest-1116982884 None] Deleting attachment 4dc54787-63a7-4b29-b5e1-b74fe5b2d6ba. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:41:51.308146 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:41:51.408128 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:41:54.548232 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Volume volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:41:55.248797 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] deleting rbd volume volume-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:42:01.636459 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Created reservations ['3bb4c3fb-33c0-433b-9047-fe5db59059aa', 'e160e535-0602-4fea-ba8d-508d8e393304', '2c8b89e6-067d-4171-a456-8de22b7bcd9a', '8af1b29c-9498-429d-9eb8-f6ee05a3e62d'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:42:01.835394 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:01.888425 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:01.952484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:42:01.956946 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Deleted volume successfully. Nov 13 21:42:02.041756 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3d6f4dae-24b0-4d4d-a04e-bf9d339ce86d tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-ec8c7562-eaeb-4b75-9d3e-1fbc19ef5522-delete_volume'" released by "delete_volume" :: held 10.733s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:42:02.959427 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:42:02.963323 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:42:02.963800 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:42:02.976800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (8207547c-76d8-43e8-a89a-3cd972b9046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:42:02.981115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994d119-6aef-43da-b107-9327db710027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:02.987035 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:42:02.999182 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f994d119-6aef-43da-b107-9327db710027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1420040370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6aa0150e-3650-4ac5-8171-75ce1947688f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dede95ed8404ed8a864fd9fee5b2946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:42:03Z,use_quota=True,user_id='42f80111073c438cb07df07471461332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:03.001702 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da08a15f-428c-40ce-8ee5-4097e45620ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:03.003768 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da08a15f-428c-40ce-8ee5-4097e45620ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:03.006129 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078b6676-8785-4f52-a90c-0e99286cccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:03.086881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (078b6676-8785-4f52-a90c-0e99286cccc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6aa0150e-3650-4ac5-8171-75ce1947688f', 'volume_name': 'volume-6aa0150e-3650-4ac5-8171-75ce1947688f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:03.089323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6a1f92-9c91-4a78-b8ef-7e2f8ec3d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:03.091466 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6a1f92-9c91-4a78-b8ef-7e2f8ec3d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:03.093631 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41122716-7a8e-4784-9163-8b76ec84c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:03.094494 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Volume 6aa0150e-3650-4ac5-8171-75ce1947688f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6aa0150e-3650-4ac5-8171-75ce1947688f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:42:03.095065 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Cloning 6aa0150e-3650-4ac5-8171-75ce1947688f from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:42:03.104317 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:42:03.207225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 42, 3, 108223)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:42:03.207571 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:42:03.207971 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:42:03.216544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.108s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:42:03.216544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:42:03.219172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 42, 3, 216751)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:42:03.219615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:42:03.220022 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:42:03.233130 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:03.533676 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] creating snapshot='volume-6aa0150e-3650-4ac5-8171-75ce1947688f.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:42:06.632421 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-6aa0150e-3650-4ac5-8171-75ce1947688f.clone_snap' to 'volume-6aa0150e-3650-4ac5-8171-75ce1947688f' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:42:08.710076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:42:08.711131 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:42:08.711506 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:42:09.376851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:42:09.379918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Marking volume 6aa0150e-3650-4ac5-8171-75ce1947688f as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:42:09.459430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 6aa0150e-3650-4ac5-8171-75ce1947688f. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:42:09.460222 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Creating volume glance metadata for volume 6aa0150e-3650-4ac5-8171-75ce1947688f backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:42:09.603472 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41122716-7a8e-4784-9163-8b76ec84c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aa0150e-3650-4ac5-8171-75ce1947688f', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:09.605693 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944fbe9d-01c2-4106-80d3-7611cb541f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:09.695005 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Volume volume-6aa0150e-3650-4ac5-8171-75ce1947688f (6aa0150e-3650-4ac5-8171-75ce1947688f): created successfully Nov 13 21:42:09.698654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944fbe9d-01c2-4106-80d3-7611cb541f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:09.702824 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (8207547c-76d8-43e8-a89a-3cd972b9046d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:42:09.785245 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-221f9f62-d3d2-46dd-8606-46aadb749847 tempest-VolumesBackupsTest-1116982884 None] Created volume successfully. Nov 13 21:42:10.607626 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-de2c538d-d91e-4a06-9de8-550a3ccd43a1 tempest-TestVolumeBootPattern-210846747 None] Created reservations ['d7429d40-57e7-4d02-ba37-5f15da4ab5dc', '29a83fa2-ac91-49c0-90bc-5103798a7a39', '8462f4d9-cbbb-48f6-8510-cb793c1e40e9', '523fc4bf-9c10-41eb-8deb-393d5918edb1'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:42:10.891744 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:42:11.025810 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-de2c538d-d91e-4a06-9de8-550a3ccd43a1 tempest-TestVolumeBootPattern-210846747 None] Delete snapshot completed successfully. Nov 13 21:42:11.032577 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-de2c538d-d91e-4a06-9de8-550a3ccd43a1 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-5acdc2a6-e983-4c55-98f6-d2ba9033e5bd-delete_snapshot'" released by "delete_snapshot" :: held 32.326s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:42:11.570915 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.679s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:42:11.572044 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6aa0150e-3650-4ac5-8171-75ce1947688f', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '6aa0150e-3650-4ac5-8171-75ce1947688f', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:42:11.586870 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] Initialize volume connection completed successfully. Nov 13 21:42:14.977960 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-1bf5fb31-0cfb-43de-bd16-119bd1471d9d tempest-TestVolumeBootPattern-210846747 None] Terminate volume connection completed successfully. Nov 13 21:42:14.978817 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-1bf5fb31-0cfb-43de-bd16-119bd1471d9d tempest-TestVolumeBootPattern-210846747 None] Deleting attachment f9aa29f5-acce-425a-8557-7296daaa68ff. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:42:15.367799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-7e246c91-e1e1-481c-bfad-005ee7585c4f-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:42:15.471439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:15.979149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:42:16.198837 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] deleting rbd volume volume-7e246c91-e1e1-481c-bfad-005ee7585c4f {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:42:21.319864 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:42:21.322190 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:21.355193 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:21.381852 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:42:28.037439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:42:28.385300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] deleting parent snapshot volume-7e246c91-e1e1-481c-bfad-005ee7585c4f.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:42:34.845288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] Created reservations ['1479432b-0837-4155-80fc-aaa2ad70fcb8', '12f05936-b70f-41e1-8765-64649742a9d8', 'f6d73f83-c480-495f-ae0a-e1d60c816333', '2918a824-7f4d-4376-91c5-d89220bbc516'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:42:35.071467 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:35.129090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:35.201757 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:42:35.206504 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] Deleted volume successfully. Nov 13 21:42:35.289443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-5e0903ca-0a32-47f0-bb88-837a9da4e71f req-781deb52-c799-4212-b5e1-6fce5138adb0 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-7e246c91-e1e1-481c-bfad-005ee7585c4f-delete_volume'" released by "delete_volume" :: held 19.922s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:42:42.390411 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:42:42.408860 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:42:42.408860 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:42:42.426454 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (a66c9ae8-d868-46df-897b-d34184f6f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:42:42.430320 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3f92f7-2a3e-4110-af11-ab3fc41cc738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:42.438845 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:42:42.452085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3f92f7-2a3e-4110-af11-ab3fc41cc738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-235581934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3c21002-3b28-4bb3-b7ec-9a099fae71cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9ae928d75cc4e4d88c3e99de8f45af8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:42:42Z,use_quota=True,user_id='007b4e8c84ec462b9c96ab9ac85f3d48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:42.455286 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6133dde-edbb-49d0-b205-c1479118ee52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:42.458499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6133dde-edbb-49d0-b205-c1479118ee52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:42.461613 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886bbfa4-ba03-4a76-bccf-ead4a5d2b2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:42.601076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886bbfa4-ba03-4a76-bccf-ead4a5d2b2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'volume_name': 'volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:42.604914 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31314f4-7b65-4ba7-8c9c-b15f8f415280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:42.607695 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e31314f4-7b65-4ba7-8c9c-b15f8f415280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:42.612155 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3d05b3-8081-4a6e-9f18-873c5337b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:42.613144 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Volume c3c21002-3b28-4bb3-b7ec-9a099fae71cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:42:42.614689 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Cloning c3c21002-3b28-4bb3-b7ec-9a099fae71cd from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:42:42.625725 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:42:42.721888 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 42, 42, 631935)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:42:42.725375 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:42:42.725375 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:42:42.731300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.106s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:42:42.733089 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:42:42.751955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 42, 42, 741593)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:42:42.754734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:42:42.754734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:42:42.769162 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:42:43.144620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] creating snapshot='volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:42:46.101102 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd.clone_snap' to 'volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:42:48.964031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:42:48.979016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:42:48.979016 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:42:49.859166 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:42:49.860172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Marking volume c3c21002-3b28-4bb3-b7ec-9a099fae71cd as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:42:49.933667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to c3c21002-3b28-4bb3-b7ec-9a099fae71cd. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:42:49.934091 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Creating volume glance metadata for volume c3c21002-3b28-4bb3-b7ec-9a099fae71cd backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:42:50.136288 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f3d05b3-8081-4a6e-9f18-873c5337b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:50.142658 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a27f6d-06e6-4324-913b-f1d109982542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:42:50.219162 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Volume volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd (c3c21002-3b28-4bb3-b7ec-9a099fae71cd): created successfully Nov 13 21:42:50.222118 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a27f6d-06e6-4324-913b-f1d109982542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:42:50.227012 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Flow 'volume_create_manager' (a66c9ae8-d868-46df-897b-d34184f6f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:42:50.333277 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9c022868-434e-40f4-9216-f9dbaaaff495 tempest-TestVolumeBootPattern-210846747 None] Created volume successfully. Nov 13 21:42:54.883676 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-a4488ce3-625a-41ef-a66c-7051ea8059cb req-66af96ad-b48e-449f-a2ac-0946dc9a76c4 tempest-TestVolumeBootPattern-210846747 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:42:55.710499 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-a4488ce3-625a-41ef-a66c-7051ea8059cb req-66af96ad-b48e-449f-a2ac-0946dc9a76c4 tempest-TestVolumeBootPattern-210846747 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.827s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:42:55.711309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-a4488ce3-625a-41ef-a66c-7051ea8059cb req-66af96ad-b48e-449f-a2ac-0946dc9a76c4 tempest-TestVolumeBootPattern-210846747 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:42:55.911336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-a4488ce3-625a-41ef-a66c-7051ea8059cb req-66af96ad-b48e-449f-a2ac-0946dc9a76c4 tempest-TestVolumeBootPattern-210846747 None] Connection info returned from driver {'name': 'volumes/volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c3c21002-3b28-4bb3-b7ec-9a099fae71cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b3445f73-73cc-4c3c-ba6f-b4250d0aefec'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 21:42:56.088367 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-a4488ce3-625a-41ef-a66c-7051ea8059cb req-66af96ad-b48e-449f-a2ac-0946dc9a76c4 tempest-TestVolumeBootPattern-210846747 None] attachment_update completed successfully. Nov 13 21:43:00.137749 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] Terminate volume connection completed successfully. Nov 13 21:43:00.154757 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f87a705e-5549-4097-9c7b-4cda4bc51bf1 tempest-VolumesBackupsTest-1116982884 None] Remove volume export completed successfully. Nov 13 21:43:01.890443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:43:01.894656 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:43:01.895148 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:43:01.911895 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (2b90ae09-3fee-4418-9d76-201ee1542c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:43:01.917149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c28f6c3-e747-4271-8c54-c0074cbaff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:01.927264 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:43:01.940952 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c28f6c3-e747-4271-8c54-c0074cbaff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:43:01Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_a621b34b-2c3b-42af-a81a-af3652e012a3',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=179cd4a0-8a38-40e1-8e48-4d0024a54b51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dede95ed8404ed8a864fd9fee5b2946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:43:02Z,use_quota=True,user_id='42f80111073c438cb07df07471461332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:01.946476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d726ddf3-8039-4b26-b300-3531dbbc6a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:01.946476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d726ddf3-8039-4b26-b300-3531dbbc6a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:01.948002 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a1caec-b34e-49d3-8470-cf18349924d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:01.950253 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a1caec-b34e-49d3-8470-cf18349924d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'volume_name': 'volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:01.952518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9531b3-217f-49e3-8903-0d9a86318074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:01.954678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9531b3-217f-49e3-8903-0d9a86318074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:01.956839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6759d5-c2a4-45d7-a715-3edc3ad69b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:01.957823 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Volume 179cd4a0-8a38-40e1-8e48-4d0024a54b51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'volume_size': 1} Nov 13 21:43:01.958240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] creating volume 'volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:43:01.959362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:02.587685 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:43:02.588168 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:43:02.590710 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6759d5-c2a4-45d7-a715-3edc3ad69b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:02.593634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a409b381-4259-45c5-a27d-20de83516eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:02.670614 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Volume volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51 (179cd4a0-8a38-40e1-8e48-4d0024a54b51): created successfully Nov 13 21:43:02.672671 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a409b381-4259-45c5-a27d-20de83516eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:02.675664 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Flow 'volume_create_manager' (2b90ae09-3fee-4418-9d76-201ee1542c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:43:02.733435 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Created volume successfully. Nov 13 21:43:03.952295 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 21:43:04.727963 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.775s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 21:43:04.728891 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '179cd4a0-8a38-40e1-8e48-4d0024a54b51', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 21:43:04.746098 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Initialize volume connection completed successfully. Nov 13 21:43:21.317553 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:43:21.319328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:21.350887 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:21.376925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:43:44.491718 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-35992587-169c-4a38-bc59-68070565be59 tempest-GroupsV320Test-428482774 None] Group tempest-GroupsV320Test-Group-1561082125: creating Nov 13 21:43:44.705681 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-35992587-169c-4a38-bc59-68070565be59 tempest-GroupsV320Test-428482774 None] Group tempest-GroupsV320Test-Group-1561082125: created successfully Nov 13 21:43:44.715339 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-35992587-169c-4a38-bc59-68070565be59 tempest-GroupsV320Test-428482774 None] Create group completed successfully. Nov 13 21:43:46.302896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-bed4687c-88f2-467a-9b05-68bb5df77afa tempest-GroupsV320Test-428482774 None] Created reservations ['8958007a-bfb7-4227-8df0-c99a39598e07'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:43:46.460712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bed4687c-88f2-467a-9b05-68bb5df77afa tempest-GroupsV320Test-428482774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:46.483663 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-bed4687c-88f2-467a-9b05-68bb5df77afa tempest-GroupsV320Test-428482774 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:46.505551 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-bed4687c-88f2-467a-9b05-68bb5df77afa tempest-GroupsV320Test-428482774 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:43:46.510235 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-bed4687c-88f2-467a-9b05-68bb5df77afa tempest-GroupsV320Test-428482774 None] Delete group completed successfully. Nov 13 21:43:53.150590 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:43:53.154410 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:43:53.154793 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:43:53.167290 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Flow 'volume_create_manager' (f71ac049-b104-437c-aaa5-3decb8e7bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:43:53.174092 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e92af5-4c9f-44b0-8d2f-970d2beae05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:53.176738 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:43:53.189923 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e92af5-4c9f-44b0-8d2f-970d2beae05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-332533976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=565a1a91-1c7b-4d34-90ba-a1f630851a80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c528447c13647688a6617f1a1978a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:43:53Z,use_quota=True,user_id='2a691a82367f4d5aabc7ae43bb672a31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:53.192431 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de655c2-b0f9-4acb-b0ea-968ac7c32413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:53.194500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5de655c2-b0f9-4acb-b0ea-968ac7c32413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:53.196795 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e226f04-8923-4303-a4c2-a8ffc54b9d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:53.199731 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e226f04-8923-4303-a4c2-a8ffc54b9d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '565a1a91-1c7b-4d34-90ba-a1f630851a80', 'volume_name': 'volume-565a1a91-1c7b-4d34-90ba-a1f630851a80', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:53.202166 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d510a0a-e910-4d92-8b87-eec8af0bef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:53.204170 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d510a0a-e910-4d92-8b87-eec8af0bef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:53.206342 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fcd6ef-e0d9-4ffe-aae4-72f5011c92b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:53.207289 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Volume 565a1a91-1c7b-4d34-90ba-a1f630851a80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-565a1a91-1c7b-4d34-90ba-a1f630851a80', 'volume_size': 1} Nov 13 21:43:53.207800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] creating volume 'volume-565a1a91-1c7b-4d34-90ba-a1f630851a80' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:43:53.208790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:54.305538 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:43:54.306201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:43:54.308471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fcd6ef-e0d9-4ffe-aae4-72f5011c92b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-565a1a91-1c7b-4d34-90ba-a1f630851a80', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:54.310654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb51d44-c37b-4094-9819-14202a89e741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:43:54.399762 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Volume volume-565a1a91-1c7b-4d34-90ba-a1f630851a80 (565a1a91-1c7b-4d34-90ba-a1f630851a80): created successfully Nov 13 21:43:54.401812 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb51d44-c37b-4094-9819-14202a89e741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:43:54.404778 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Flow 'volume_create_manager' (f71ac049-b104-437c-aaa5-3decb8e7bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:43:54.492616 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-dbdb5dde-1ee4-4430-8e65-55db11ea1c83 tempest-SnapshotsActionsTest-1895444552 None] Created volume successfully. Nov 13 21:43:55.557223 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd03466c-c6d5-4c9c-a956-a76dff8ef8eb tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:43:58.449557 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Terminate volume connection completed successfully. Nov 13 21:43:58.465578 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-b81f370f-44bc-4d11-b450-04c3fce6f09d tempest-VolumesBackupsTest-1116982884 None] Remove volume export completed successfully. Nov 13 21:43:58.902838 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fd03466c-c6d5-4c9c-a956-a76dff8ef8eb tempest-SnapshotsActionsTest-1895444552 None] Create snapshot completed successfully Nov 13 21:43:59.572444 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-179cd4a0-8a38-40e1-8e48-4d0024a54b51-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:43:59.650941 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:01.976981 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Volume volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:44:02.384309 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] deleting rbd volume volume-179cd4a0-8a38-40e1-8e48-4d0024a54b51 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:44:02.451279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-163ae0cf-7407-4077-9191-e0b7cc21ed37 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:06.007534 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-163ae0cf-7407-4077-9191-e0b7cc21ed37 tempest-SnapshotsActionsTest-1895444552 None] Create snapshot completed successfully Nov 13 21:44:06.666429 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5ac817b6-6bcd-472a-941b-f183588f9bab tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-d5f5bfff-fa49-4e11-a9c9-88a586da11f2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:06.674362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5ac817b6-6bcd-472a-941b-f183588f9bab tempest-SnapshotsActionsTest-656406791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:11.199934 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-5ac817b6-6bcd-472a-941b-f183588f9bab tempest-SnapshotsActionsTest-656406791 None] Created reservations ['9eaea297-f358-4aab-990a-4768c9956408', '8d2b17d4-34a9-49cd-9255-e84d5c86a997', '59a2f818-0354-48eb-8096-9464da7d32c5', 'dea933ff-6ff8-4a11-9738-63543f662db8'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:11.384018 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5ac817b6-6bcd-472a-941b-f183588f9bab tempest-SnapshotsActionsTest-656406791 None] Delete snapshot completed successfully. Nov 13 21:44:11.388802 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5ac817b6-6bcd-472a-941b-f183588f9bab tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-d5f5bfff-fa49-4e11-a9c9-88a586da11f2-delete_snapshot'" released by "delete_snapshot" :: held 4.723s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:12.501224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-1cc0bb72-f63a-48e4-ae42-29200ad17337 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:12.898415 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Created reservations ['994388da-29ca-402a-8a62-6c16322608dc', 'd56d16ad-30d2-48de-8ddc-9ab03d31e60a', 'a7a09daf-da10-4197-bb1f-56a0326c44cc', '89446a8e-2dcc-4602-8b97-9a713256b092'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:13.092697 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:13.115300 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:13.137581 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:44:13.141933 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Deleted volume successfully. Nov 13 21:44:13.199336 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-720f36ec-f4fa-447b-ae54-90fe91cc9ab7 tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-179cd4a0-8a38-40e1-8e48-4d0024a54b51-delete_volume'" released by "delete_volume" :: held 13.627s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:15.725743 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-1cc0bb72-f63a-48e4-ae42-29200ad17337 tempest-SnapshotsActionsTest-1895444552 None] Create snapshot completed successfully Nov 13 21:44:16.634202 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3f65861d-eb2e-4b5f-9e07-bbbb8ba273f6 tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-a01a1520-93dc-4771-9fe5-e87a10b48073-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:16.635556 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3f65861d-eb2e-4b5f-9e07-bbbb8ba273f6 tempest-SnapshotsActionsTest-656406791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:20.898902 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-3f65861d-eb2e-4b5f-9e07-bbbb8ba273f6 tempest-SnapshotsActionsTest-656406791 None] Created reservations ['d1378372-6f5a-4a06-bdbe-548b5f14dea8', 'f62bc521-195a-4ef4-b03c-01c1e96a5d72', '2387b8a5-5db3-4401-9440-2d973a5d0eb7', 'c97b87f8-7f40-4203-9783-5afc2de2c9d1'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:21.053204 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3f65861d-eb2e-4b5f-9e07-bbbb8ba273f6 tempest-SnapshotsActionsTest-656406791 None] Delete snapshot completed successfully. Nov 13 21:44:21.059568 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-3f65861d-eb2e-4b5f-9e07-bbbb8ba273f6 tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-a01a1520-93dc-4771-9fe5-e87a10b48073-delete_snapshot'" released by "delete_snapshot" :: held 4.425s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:21.324268 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:44:21.324268 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:21.360956 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:21.393626 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:44:22.416961 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-148b2a7f-9280-4a5e-9021-d897b96a7a94 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:26.376712 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-148b2a7f-9280-4a5e-9021-d897b96a7a94 tempest-SnapshotsActionsTest-1895444552 None] Create snapshot completed successfully Nov 13 21:44:27.680064 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-201d802f-742c-47b6-ab0b-6af7466c81dd tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-01e9b2e4-887c-49d9-9c38-f34d5c7f42c3-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:27.681530 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-201d802f-742c-47b6-ab0b-6af7466c81dd tempest-SnapshotsActionsTest-656406791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:30.010811 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-6aa0150e-3650-4ac5-8171-75ce1947688f-delete_volume'" acquired by "delete_volume" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:30.121542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:34.031705 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] deleting rbd volume volume-6aa0150e-3650-4ac5-8171-75ce1947688f {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:44:34.730905 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-201d802f-742c-47b6-ab0b-6af7466c81dd tempest-SnapshotsActionsTest-656406791 None] Created reservations ['1263b0e3-fee6-4eb3-bbb4-df51d7897939', '7d72e229-2b6f-49d1-ac7c-3528a89dc577', '0677fd13-d3ea-40fc-bf1c-7bc3b668d807', '70bf692d-34bf-4b90-82f8-2118dc03059b'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:34.892188 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-201d802f-742c-47b6-ab0b-6af7466c81dd tempest-SnapshotsActionsTest-656406791 None] Delete snapshot completed successfully. Nov 13 21:44:34.897856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-201d802f-742c-47b6-ab0b-6af7466c81dd tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-01e9b2e4-887c-49d9-9c38-f34d5c7f42c3-delete_snapshot'" released by "delete_snapshot" :: held 7.217s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:35.549515 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-31ada3cc-4f21-482e-af5c-75656032f4e0 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:38.789262 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-31ada3cc-4f21-482e-af5c-75656032f4e0 tempest-SnapshotsActionsTest-1895444552 None] Create snapshot completed successfully Nov 13 21:44:39.806615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-59d9277d-1d9a-4bee-8993-78c5acfa1318 tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-f76547c8-8021-4f62-8165-c7222f56c696-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:39.807595 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-59d9277d-1d9a-4bee-8993-78c5acfa1318 tempest-SnapshotsActionsTest-656406791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:41.025227 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:44:41.253498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] deleting parent snapshot volume-6aa0150e-3650-4ac5-8171-75ce1947688f.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:44:46.229727 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] Created reservations ['7ca88d09-f248-4140-ad13-9c168ba0fb77', '27304350-20c3-4caf-af5d-0edeb19e0230', 'c5be9ec2-7670-41cb-9878-274b6091442f', '6d61463d-722b-43c0-a757-35b918b11965'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:46.395624 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:46.416781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:46.443644 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:44:46.448031 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] Deleted volume successfully. Nov 13 21:44:46.511737 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2f47e6ed-bd9d-455e-9822-32188425f4aa tempest-VolumesBackupsTest-1116982884 None] Lock "b'cinder-6aa0150e-3650-4ac5-8171-75ce1947688f-delete_volume'" released by "delete_volume" :: held 16.501s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:46.887682 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-59d9277d-1d9a-4bee-8993-78c5acfa1318 tempest-SnapshotsActionsTest-656406791 None] Created reservations ['61386238-3af8-4a6d-a39d-80320a6b8e71', '1c5e3b7d-b96e-4017-99ae-5aa0f5ba0963', '3cf644f5-a278-4a92-91b7-f4dc041d470c', 'bd216382-05e0-4dfd-95f2-a3513a8a1877'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:47.053060 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-59d9277d-1d9a-4bee-8993-78c5acfa1318 tempest-SnapshotsActionsTest-656406791 None] Delete snapshot completed successfully. Nov 13 21:44:47.058449 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-59d9277d-1d9a-4bee-8993-78c5acfa1318 tempest-SnapshotsActionsTest-656406791 None] Lock "b'cinder-f76547c8-8021-4f62-8165-c7222f56c696-delete_snapshot'" released by "delete_snapshot" :: held 7.252s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:48.924712 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-fd89c685-b783-44b7-a680-4b2590d68413 tempest-SnapshotsActionsTest-1895444552 None] Lock "b'cinder-888e8f8b-6202-461a-9371-b676f4ae32f2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:48.925332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-fd89c685-b783-44b7-a680-4b2590d68413 tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:50.297854 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:44:50.301945 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:44:50.302384 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:44:50.314363 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Flow 'volume_create_manager' (df8d500b-8409-4f84-b079-05f4a53ddb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:44:50.318047 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a1fc91-2c9d-44f0-82ed-e3adac7650af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:50.325135 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:44:50.337314 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a1fc91-2c9d-44f0-82ed-e3adac7650af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1230932968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cb5cf69d-f2d0-417d-8af3-1857d9fdd31b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='972579de5bc44da3bb41e8904e50d2fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:44:50Z,use_quota=True,user_id='9dd847d972a8484486356bbc55fad4fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:50.339880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b9d1c4-d360-4d4e-9830-fb02f34177a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:50.342036 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b9d1c4-d360-4d4e-9830-fb02f34177a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:50.344380 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee4eae-5121-46e7-a117-830cfef8ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:50.346599 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1ee4eae-5121-46e7-a117-830cfef8ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb5cf69d-f2d0-417d-8af3-1857d9fdd31b', 'volume_name': 'volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:50.348846 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2246ecc-e296-48fd-91cd-1313106be76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:50.350885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2246ecc-e296-48fd-91cd-1313106be76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:50.353354 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9b93c7-cac6-4824-a2ea-9b0c7e3b7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:50.354119 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Volume cb5cf69d-f2d0-417d-8af3-1857d9fdd31b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b', 'volume_size': 1} Nov 13 21:44:50.354508 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] creating volume 'volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:44:50.355471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:51.621935 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:44:51.623011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:44:51.625063 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f9b93c7-cac6-4824-a2ea-9b0c7e3b7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:51.627166 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cecf16-3b41-44c4-9363-0c95c9a39e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:44:51.760660 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Volume volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b (cb5cf69d-f2d0-417d-8af3-1857d9fdd31b): created successfully Nov 13 21:44:51.765245 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31cecf16-3b41-44c4-9363-0c95c9a39e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:44:51.766101 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Flow 'volume_create_manager' (df8d500b-8409-4f84-b079-05f4a53ddb8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:44:51.881150 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ba23634c-7174-438b-a652-bbacc6fe706d tempest-VolumesSnapshotListTestJSON-2050227631 None] Created volume successfully. Nov 13 21:44:52.760352 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7cc36414-9dab-452c-89c3-34b82ba451ce tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:53.998915 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-fd89c685-b783-44b7-a680-4b2590d68413 tempest-SnapshotsActionsTest-1895444552 None] Created reservations ['50f1a817-061e-43b9-90b6-28f53b0c2db2', 'b6c786f8-8c0a-4f3d-86bb-8a3d461834fd', '37c5b5b8-7088-4416-9ef7-8e881acc8a81', '60aadc6d-8cfb-458b-8fe8-fb3df4a1458d'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:44:54.184095 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-fd89c685-b783-44b7-a680-4b2590d68413 tempest-SnapshotsActionsTest-1895444552 None] Delete snapshot completed successfully. Nov 13 21:44:54.190885 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-fd89c685-b783-44b7-a680-4b2590d68413 tempest-SnapshotsActionsTest-1895444552 None] Lock "b'cinder-888e8f8b-6202-461a-9371-b676f4ae32f2-delete_snapshot'" released by "delete_snapshot" :: held 5.267s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:44:55.421938 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Lock "b'cinder-565a1a91-1c7b-4d34-90ba-a1f630851a80-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:44:55.537776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:44:55.816127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:44:55.816629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Volume volume-565a1a91-1c7b-4d34-90ba-a1f630851a80 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:44:56.028404 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] deleting rbd volume volume-565a1a91-1c7b-4d34-90ba-a1f630851a80 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:44:56.818031 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7cc36414-9dab-452c-89c3-34b82ba451ce tempest-VolumesSnapshotListTestJSON-2050227631 None] Create snapshot completed successfully Nov 13 21:44:58.229218 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-66b2e2e9-5350-4815-b54a-49004dad28af tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:01.337342 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-66b2e2e9-5350-4815-b54a-49004dad28af tempest-VolumesSnapshotListTestJSON-2050227631 None] Create snapshot completed successfully Nov 13 21:45:02.787534 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-93a39af0-5b93-4fa6-ac7e-f0d6a337954e tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:03.343986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Created reservations ['1b1d7994-24d3-4273-9182-1b6d32a5c740', 'a9231cf2-6bf5-4038-ba9d-64292c9ecf45', 'b75aa5ce-4ffd-45cf-b02b-f35aa9dbb017', '5a519ff6-bdf7-4c0b-967f-7602f78a8955'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:03.539387 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:03.561085 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:03.585715 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:03.590080 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Deleted volume successfully. Nov 13 21:45:03.656728 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-d729fa39-befb-4744-874e-10d58eabac0b tempest-SnapshotsActionsTest-1895444552 None] Lock "b'cinder-565a1a91-1c7b-4d34-90ba-a1f630851a80-delete_volume'" released by "delete_volume" :: held 8.235s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:06.195191 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-93a39af0-5b93-4fa6-ac7e-f0d6a337954e tempest-VolumesSnapshotListTestJSON-2050227631 None] Create snapshot completed successfully Nov 13 21:45:07.502080 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f9d60126-8833-4720-bebb-1c9e6752ca9c tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-eb94c18a-2cba-4a35-9eec-f206e5e4145c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:07.502080 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f9d60126-8833-4720-bebb-1c9e6752ca9c tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:11.983715 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f9d60126-8833-4720-bebb-1c9e6752ca9c tempest-VolumesSnapshotListTestJSON-2050227631 None] Created reservations ['2b95f9e0-9319-4d68-851b-38b32f73f0f7', 'e8e4ba56-7004-4f4c-b24b-a1c407d5a619', 'cf4d8ab2-49a0-4792-a49e-75774ae4c29b', 'b73cd06b-3158-4eb6-9f9a-dd6590dcb8c3'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:12.147753 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f9d60126-8833-4720-bebb-1c9e6752ca9c tempest-VolumesSnapshotListTestJSON-2050227631 None] Delete snapshot completed successfully. Nov 13 21:45:12.152509 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f9d60126-8833-4720-bebb-1c9e6752ca9c tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-eb94c18a-2cba-4a35-9eec-f206e5e4145c-delete_snapshot'" released by "delete_snapshot" :: held 4.653s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:12.792906 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-734f4e32-240f-4be9-927c-fea32a69da6e tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-d3b4fa9b-58ce-46ca-a027-98371ca1be64-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:12.794629 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-734f4e32-240f-4be9-927c-fea32a69da6e tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:14.841923 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:45:14.845707 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:45:14.846144 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:45:14.858337 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (d937bf8c-1788-4ae8-9655-632d6fb23966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:14.861356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f1c1b6-8b23-4a2d-a2b8-0cc84e65e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:14.867703 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:45:14.879808 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f1c1b6-8b23-4a2d-a2b8-0cc84e65e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1337778190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=77acd7e7-78ce-40be-beb2-440f5a418081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46847bdcb8f4aa898d7e0fb6a5cf643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:45:15Z,use_quota=True,user_id='7ff37566b43f4656934431f5ad62e0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:14.882849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2d7954-78cd-403e-ba3a-f24973bebce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:14.885036 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2d7954-78cd-403e-ba3a-f24973bebce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:14.887280 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e2131-f96b-468d-8596-1cf217f955de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:14.889420 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c28e2131-f96b-468d-8596-1cf217f955de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77acd7e7-78ce-40be-beb2-440f5a418081', 'volume_name': 'volume-77acd7e7-78ce-40be-beb2-440f5a418081', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:14.891925 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cd094a-5c4f-495a-afc4-9c179c2190c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:14.896061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cd094a-5c4f-495a-afc4-9c179c2190c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:14.896176 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b68016-73f7-4f2f-9f02-74bd522e64a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:14.896863 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Volume 77acd7e7-78ce-40be-beb2-440f5a418081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77acd7e7-78ce-40be-beb2-440f5a418081', 'volume_size': 1} Nov 13 21:45:14.897245 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] creating volume 'volume-77acd7e7-78ce-40be-beb2-440f5a418081' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:45:14.898181 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:15.986484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:45:15.987564 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:45:15.989585 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9b68016-73f7-4f2f-9f02-74bd522e64a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77acd7e7-78ce-40be-beb2-440f5a418081', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:15.992228 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b88a53-3d37-4119-b3ba-6cac3d925f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:16.040298 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-77acd7e7-78ce-40be-beb2-440f5a418081 (77acd7e7-78ce-40be-beb2-440f5a418081): created successfully Nov 13 21:45:16.042202 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b88a53-3d37-4119-b3ba-6cac3d925f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:16.045059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (d937bf8c-1788-4ae8-9655-632d6fb23966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:16.097871 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-3d52eaa7-9cc1-4598-979f-290d89d8c096 tempest-VolumesListAdminTestJSON-1471133319 None] Created volume successfully. Nov 13 21:45:17.320846 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-734f4e32-240f-4be9-927c-fea32a69da6e tempest-VolumesSnapshotListTestJSON-2050227631 None] Created reservations ['c2dd580e-4d43-458c-8f95-beb6a7f1a4bf', '22b3fbed-6b4e-47e9-854d-b42f0890a6a7', '5405b32b-5f3c-4da6-a31e-ff4bc18b5f1d', '4e67b707-d4db-410c-a2dd-be111f343f3c'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:17.480277 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:45:17.483510 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:45:17.483944 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:45:17.496473 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (a5382b7c-977b-4313-8489-f35da6820306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:17.499469 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efabb5fd-07a4-43af-b238-ae5f499474cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:17.505121 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:45:17.509183 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-734f4e32-240f-4be9-927c-fea32a69da6e tempest-VolumesSnapshotListTestJSON-2050227631 None] Delete snapshot completed successfully. Nov 13 21:45:17.523011 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efabb5fd-07a4-43af-b238-ae5f499474cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:45:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1161947514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e826eb03-0b29-4a70-8d84-e27926fd9d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46847bdcb8f4aa898d7e0fb6a5cf643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:45:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:45:17Z,use_quota=True,user_id='7ff37566b43f4656934431f5ad62e0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:17.523200 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e11df3e-8f65-43ea-8542-dbb7ca85437a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:17.524921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e11df3e-8f65-43ea-8542-dbb7ca85437a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:17.527240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2723f26e-5260-4dc8-b2fb-37211c1c0a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:17.529436 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2723f26e-5260-4dc8-b2fb-37211c1c0a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e826eb03-0b29-4a70-8d84-e27926fd9d3c', 'volume_name': 'volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:17.531667 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c203580-41b3-4d65-9ea7-603ea85c2778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:17.533737 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c203580-41b3-4d65-9ea7-603ea85c2778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:17.535871 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96104fc6-992a-478d-a85d-ffdf167cd438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:17.536634 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Volume e826eb03-0b29-4a70-8d84-e27926fd9d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c', 'volume_size': 1} Nov 13 21:45:17.537565 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] creating volume 'volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:45:17.538535 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:17.559399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-734f4e32-240f-4be9-927c-fea32a69da6e tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-d3b4fa9b-58ce-46ca-a027-98371ca1be64-delete_snapshot'" released by "delete_snapshot" :: held 4.766s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:18.036845 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-df354687-c900-4f3c-b97c-b40bb6ebb408 tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-1fb04c21-ecee-4f46-ab0e-ddec0aa6f023-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:18.038723 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-df354687-c900-4f3c-b97c-b40bb6ebb408 tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:18.448999 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:45:18.449659 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:45:18.451586 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96104fc6-992a-478d-a85d-ffdf167cd438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:18.453781 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1ffbc4-c783-424c-9174-4fc08fe5739b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:18.491613 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c (e826eb03-0b29-4a70-8d84-e27926fd9d3c): created successfully Nov 13 21:45:18.493445 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1ffbc4-c783-424c-9174-4fc08fe5739b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:18.496431 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (a5382b7c-977b-4313-8489-f35da6820306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:18.554883 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6fb206e1-0bbb-4635-9d89-8d97f4d491d5 tempest-VolumesListAdminTestJSON-1471133319 None] Created volume successfully. Nov 13 21:45:20.162800 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:45:20.166123 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:45:20.166845 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:45:20.179768 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (1a2a1dd6-8467-4280-abf5-2e50c3edfc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:20.182822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d65b6-866f-46a2-9b6b-88ff5affe0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:20.188465 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:45:20.203498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033d65b6-866f-46a2-9b6b-88ff5affe0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-140285945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d7228f0b-6e0e-41dc-9684-558c5eb172a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f46847bdcb8f4aa898d7e0fb6a5cf643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:45:20Z,use_quota=True,user_id='7ff37566b43f4656934431f5ad62e0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:20.206043 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf56019-c493-450b-8ac4-f82466530aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:20.208057 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf56019-c493-450b-8ac4-f82466530aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:20.210501 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c5bbac-aefa-41b3-a46e-fa5919f205cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:20.212620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c5bbac-aefa-41b3-a46e-fa5919f205cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7228f0b-6e0e-41dc-9684-558c5eb172a0', 'volume_name': 'volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:20.214851 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c6caa-dc2b-4f82-a54f-bedcea3cef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:20.216924 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (679c6caa-dc2b-4f82-a54f-bedcea3cef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:20.219078 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda852b6-7dbc-442c-bc78-b914209592cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:20.219817 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Volume d7228f0b-6e0e-41dc-9684-558c5eb172a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0', 'volume_size': 1} Nov 13 21:45:20.220201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] creating volume 'volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:45:20.221168 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:21.047108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:45:21.047476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:45:21.049470 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fda852b6-7dbc-442c-bc78-b914209592cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:21.051597 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722df67e-6da2-4b56-8232-a808487797f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:21.171856 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0 (d7228f0b-6e0e-41dc-9684-558c5eb172a0): created successfully Nov 13 21:45:21.173776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722df67e-6da2-4b56-8232-a808487797f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:21.177015 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Flow 'volume_create_manager' (1a2a1dd6-8467-4280-abf5-2e50c3edfc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:21.269204 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8c1ce824-a5f1-4605-bd92-384573cf7cde tempest-VolumesListAdminTestJSON-1471133319 None] Created volume successfully. Nov 13 21:45:21.319941 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:45:21.320648 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:21.345270 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:21.367647 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:22.134211 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-df354687-c900-4f3c-b97c-b40bb6ebb408 tempest-VolumesSnapshotListTestJSON-2050227631 None] Created reservations ['d8788a26-ad5a-45d1-b073-479918881a40', '60f22ddb-4d9e-43af-9de8-e704a574b31b', '250daec4-187f-4270-a2da-300cbc90c372', '3f86f320-19ba-40a4-9ed6-a6ebb8af47f4'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:22.307815 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-df354687-c900-4f3c-b97c-b40bb6ebb408 tempest-VolumesSnapshotListTestJSON-2050227631 None] Delete snapshot completed successfully. Nov 13 21:45:22.315378 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-df354687-c900-4f3c-b97c-b40bb6ebb408 tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-1fb04c21-ecee-4f46-ab0e-ddec0aa6f023-delete_snapshot'" released by "delete_snapshot" :: held 4.276s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:23.104986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:45:23.108090 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:45:23.108507 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:45:23.120717 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Flow 'volume_create_manager' (eac77f17-eb15-4c50-8054-a138a3e43349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:23.123720 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932769a6-e9ff-4dd5-8e79-22f1108096f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:23.129701 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:45:23.142971 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932769a6-e9ff-4dd5-8e79-22f1108096f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0dfdad7e-d080-4f65-856c-74cb0d0e52a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c7312c5a2741e3a1c024edfa4b1550',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:45:23Z,use_quota=True,user_id='af731a05f6af4f8fbf849e9dbc059847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:23.145480 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83009a61-c529-430f-ad8e-baf4fca3a9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:23.147553 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83009a61-c529-430f-ad8e-baf4fca3a9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:23.149981 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7bd6db-c673-4479-852f-9ab5ac160252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:23.152126 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7bd6db-c673-4479-852f-9ab5ac160252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfdad7e-d080-4f65-856c-74cb0d0e52a4', 'volume_name': 'volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:23.154399 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126034fa-0d0f-4a2d-8171-2b220d1f4f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:23.156430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (126034fa-0d0f-4a2d-8171-2b220d1f4f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:23.158672 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9012e-ba8d-43c8-883c-5afaf301a61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:23.159454 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Volume 0dfdad7e-d080-4f65-856c-74cb0d0e52a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4', 'volume_size': 1} Nov 13 21:45:23.159833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] creating volume 'volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:45:23.160822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:23.404015 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:23.497542 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:23.718115 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:45:23.718683 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Volume volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:45:23.898051 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] deleting rbd volume volume-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:45:24.110485 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:45:24.110858 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:45:24.112918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc9012e-ba8d-43c8-883c-5afaf301a61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:24.115037 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7657179-4e68-49e8-815f-2e2478b4770c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:24.183201 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Volume volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4 (0dfdad7e-d080-4f65-856c-74cb0d0e52a4): created successfully Nov 13 21:45:24.185063 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7657179-4e68-49e8-815f-2e2478b4770c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:24.187960 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Flow 'volume_create_manager' (eac77f17-eb15-4c50-8054-a138a3e43349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:24.278973 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-112cc08c-ffcb-4482-b0f7-bb3e55a7ab6d tempest-VolumesListAdminTestJSON-1561432405 None] Created volume successfully. Nov 13 21:45:25.214737 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Lock "b'cinder-0dfdad7e-d080-4f65-856c-74cb0d0e52a4-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:25.290076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:25.503880 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:45:25.504311 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Volume volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:45:25.692278 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] deleting rbd volume volume-0dfdad7e-d080-4f65-856c-74cb0d0e52a4 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:45:25.705763 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-d7228f0b-6e0e-41dc-9684-558c5eb172a0-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:25.794891 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:26.017504 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:45:26.018046 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:45:26.320980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] deleting rbd volume volume-d7228f0b-6e0e-41dc-9684-558c5eb172a0 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:45:30.972519 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Created reservations ['0cc98575-980c-4129-ac31-3b28cfd07f61', '9d902bdb-1e3b-475b-ba02-8f26bf2e4f57', 'bd5cb1aa-6268-45ac-9ba3-d556205a9293', '6ae8a013-3d49-4066-a82d-072b53fb9382'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:31.124790 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:31.147478 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:31.175928 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:31.181149 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Deleted volume successfully. Nov 13 21:45:31.269606 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-95355282-daea-4b85-87f8-2f73032abce0 tempest-VolumesSnapshotListTestJSON-2050227631 None] Lock "b'cinder-cb5cf69d-f2d0-417d-8af3-1857d9fdd31b-delete_volume'" released by "delete_volume" :: held 7.866s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:33.238713 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Created reservations ['682108f1-5cb3-4630-919a-f7bb01121af1', '671b6223-142b-4bc1-b65d-16aa7792eaba', '9d1934a5-99de-4640-810f-f6abeff54e63', 'e14eea37-af48-47aa-8aa6-5ab5580c8435'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:33.269045 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Created reservations ['b3696498-23af-41ef-a7fa-5f6662ce438a', '9646f969-f407-4b1c-9be5-3525b15299a1', 'a206fc98-4ab0-4384-82a9-b25dee34db63', '783ade97-ba62-4b09-a969-a09a41dd7d00'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:33.512777 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:33.577759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:33.751574 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:33.753499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:33.777576 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:33.821476 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:33.827619 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Deleted volume successfully. Nov 13 21:45:33.831543 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Deleted volume successfully. Nov 13 21:45:33.949138 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-74f79e4d-1d16-4d59-90c7-1ef8bd11bc3d tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-d7228f0b-6e0e-41dc-9684-558c5eb172a0-delete_volume'" released by "delete_volume" :: held 8.243s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:34.043065 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-8a6fa5d2-31c5-48c7-a1a9-317969799fd9 tempest-VolumesListAdminTestJSON-1561432405 None] Lock "b'cinder-0dfdad7e-d080-4f65-856c-74cb0d0e52a4-delete_volume'" released by "delete_volume" :: held 8.828s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:34.162009 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-e826eb03-0b29-4a70-8d84-e27926fd9d3c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:34.313218 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:34.554434 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:45:34.555304 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:45:34.646962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] deleting rbd volume volume-e826eb03-0b29-4a70-8d84-e27926fd9d3c {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:45:43.109122 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Created reservations ['3da62725-8ece-4f57-b639-4edc36a90a51', 'c6ff53cb-ce5c-4c16-8909-1c997041971c', 'be59290e-560d-454b-806c-5e94fb39f05e', '53742807-e1f3-40b9-a84a-ccf10d8fb9f3'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:43.309746 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:43.353862 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:43.440448 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:43.446854 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Deleted volume successfully. Nov 13 21:45:43.558193 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-89c16526-f921-4323-9a8a-ff43e7d91734 tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-e826eb03-0b29-4a70-8d84-e27926fd9d3c-delete_volume'" released by "delete_volume" :: held 9.396s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:43.934160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-77acd7e7-78ce-40be-beb2-440f5a418081-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:44.102900 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:44.484471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:45:44.486013 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Volume volume-77acd7e7-78ce-40be-beb2-440f5a418081 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:45:44.760462 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] deleting rbd volume volume-77acd7e7-78ce-40be-beb2-440f5a418081 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:45:52.709090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Created reservations ['cda0a8d1-d3cb-4b33-b66b-c394f49c9c4d', '38cd947a-b138-48c4-93ad-d9ac37546148', '9c3deb29-7d7f-476d-bce0-2f86b264d493', '0c6dbe6a-f2d8-4f62-8361-7887a6afbd90'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:45:53.098127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:53.141094 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:53.177366 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:45:53.181725 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Deleted volume successfully. Nov 13 21:45:53.301850 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-79879088-f900-4b68-bc54-26c2ef1b4984 tempest-VolumesListAdminTestJSON-1471133319 None] Lock "b'cinder-77acd7e7-78ce-40be-beb2-440f5a418081-delete_volume'" released by "delete_volume" :: held 9.363s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:58.967582 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:45:58.973615 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:45:58.974899 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:45:58.994617 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Flow 'volume_create_manager' (239d3b83-3af9-461f-92aa-758fdf8df4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:45:58.999709 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5b57ac-65ec-4852-841d-164fc94df928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:59.008571 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:45:59.028883 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f5b57ac-65ec-4852-841d-164fc94df928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-435991252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2976ac03-04e1-4cc5-9a8b-2c66c4cda802,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0199b48ff5ca4e9f8630b04f2fa6720a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:45:59Z,use_quota=True,user_id='4bd10351a50b49b3ae538fb25d9150a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:59.031702 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27820cc7-7320-4037-beec-06b812824ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:59.035277 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27820cc7-7320-4037-beec-06b812824ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:59.037889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b90aa8b-347b-41d6-8765-853fe2951a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:59.134214 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b90aa8b-347b-41d6-8765-853fe2951a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2976ac03-04e1-4cc5-9a8b-2c66c4cda802', 'volume_name': 'volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:59.134429 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a86da-1cac-4963-bdf6-3692592b519b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:59.137203 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (338a86da-1cac-4963-bdf6-3692592b519b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:45:59.139306 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e3a70b-f554-49cb-9d9f-790bb2da9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:45:59.140135 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Volume 2976ac03-04e1-4cc5-9a8b-2c66c4cda802: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 21:45:59.140706 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Cloning 2976ac03-04e1-4cc5-9a8b-2c66c4cda802 from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 21:45:59.149516 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:45:59.331853 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 45, 59, 153915)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:45:59.332321 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:45:59.334328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 21:45:59.337801 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.188s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:45:59.339788 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 21:45:59.346498 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 21, 45, 59, 343808)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 21:45:59.346917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 21:45:59.347401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 21:45:59.362584 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:45:59.674039 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] creating snapshot='volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 21:46:02.543917 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802.clone_snap' to 'volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 21:46:04.027464 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:46:04.030053 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:46:04.030430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:46:04.430666 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 21:46:04.431279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Marking volume 2976ac03-04e1-4cc5-9a8b-2c66c4cda802 as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 21:46:04.540867 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 2976ac03-04e1-4cc5-9a8b-2c66c4cda802. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 21:46:04.541401 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Creating volume glance metadata for volume 2976ac03-04e1-4cc5-9a8b-2c66c4cda802 backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 21:46:04.720141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86e3a70b-f554-49cb-9d9f-790bb2da9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:04.722302 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a011fe-aa25-4a5d-b61a-27c595acf96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:04.815556 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Volume volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802 (2976ac03-04e1-4cc5-9a8b-2c66c4cda802): created successfully Nov 13 21:46:04.817556 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a011fe-aa25-4a5d-b61a-27c595acf96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:04.820654 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Flow 'volume_create_manager' (239d3b83-3af9-461f-92aa-758fdf8df4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:46:04.926203 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-6aee87eb-b99d-4595-b960-4ea4012254cc tempest-VolumesExtendTest-927577097 None] Created volume successfully. Nov 13 21:46:05.214559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-936fa05e-24f8-4554-84c5-3620c0e88c2d tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:07.234007 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-936fa05e-24f8-4554-84c5-3620c0e88c2d tempest-VolumesExtendTest-927577097 None] Extend volume from 1 GB to 2 GB. {{(pid=129109) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1731}} Nov 13 21:46:07.412016 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-936fa05e-24f8-4554-84c5-3620c0e88c2d tempest-VolumesExtendTest-927577097 None] Extend volume completed successfully. Nov 13 21:46:09.326355 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 21:46:09.329109 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 21:46:09.329676 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 21:46:09.341113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Flow 'volume_create_manager' (736ec4f5-8735-4f66-8bc3-39aee6db3665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:46:09.344463 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be651a1-1985-4be0-8145-45b604213245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:09.350340 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 21:46:09.363109 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be651a1-1985-4be0-8145-45b604213245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T21:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-456205709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ba492a26-f9a2-419a-8b12-8db8aaec8b00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0199b48ff5ca4e9f8630b04f2fa6720a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T21:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T21:46:09Z,use_quota=True,user_id='4bd10351a50b49b3ae538fb25d9150a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:09.365671 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1798a769-2991-40cd-8dcb-c122fc0fa381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:09.367778 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1798a769-2991-40cd-8dcb-c122fc0fa381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:09.370114 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70c04b-8759-4bc8-ab2a-f653788b021f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:09.372822 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f70c04b-8759-4bc8-ab2a-f653788b021f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba492a26-f9a2-419a-8b12-8db8aaec8b00', 'volume_name': 'volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:09.375061 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61149176-1bba-4a2c-b119-2597ab05e4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:09.377141 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61149176-1bba-4a2c-b119-2597ab05e4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:09.379303 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a45ea3-28cb-468d-ab30-a8916730bf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:09.380070 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Volume ba492a26-f9a2-419a-8b12-8db8aaec8b00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00', 'volume_size': 1} Nov 13 21:46:09.380638 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] creating volume 'volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 21:46:09.381636 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:10.127368 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 21:46:10.127963 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 21:46:10.130105 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a45ea3-28cb-468d-ab30-a8916730bf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:10.133240 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd6163-3436-407c-8b91-7bcde6f58159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 21:46:10.255443 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Volume volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00 (ba492a26-f9a2-419a-8b12-8db8aaec8b00): created successfully Nov 13 21:46:10.255443 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2fd6163-3436-407c-8b91-7bcde6f58159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 21:46:10.257570 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Flow 'volume_create_manager' (736ec4f5-8735-4f66-8bc3-39aee6db3665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 21:46:10.343586 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5fef4553-c85a-48ed-8178-acdf10a9f0fe tempest-VolumesExtendTest-927577097 None] Created volume successfully. Nov 13 21:46:11.774543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2248c36e-d750-450d-afc8-4ee1614a2364 tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:15.594629 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2248c36e-d750-450d-afc8-4ee1614a2364 tempest-VolumesExtendTest-927577097 None] Create snapshot completed successfully Nov 13 21:46:15.938586 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73fae21-4e74-4913-b536-58c178b458b5 tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:18.089335 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-a73fae21-4e74-4913-b536-58c178b458b5 tempest-VolumesExtendTest-927577097 None] Extend volume from 1 GB to 2 GB. {{(pid=129109) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1731}} Nov 13 21:46:18.262660 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-a73fae21-4e74-4913-b536-58c178b458b5 tempest-VolumesExtendTest-927577097 None] Extend volume completed successfully. Nov 13 21:46:19.292412 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-459ba1de-41b9-49b5-a3f6-4b4cf252d53d tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-5a739d8b-b4b3-4268-948a-bc9a0c59fc72-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:46:19.293896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-459ba1de-41b9-49b5-a3f6-4b4cf252d53d tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:21.323373 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:46:21.324153 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:21.348921 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:21.373646 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:46:23.605626 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-459ba1de-41b9-49b5-a3f6-4b4cf252d53d tempest-VolumesExtendTest-927577097 None] Created reservations ['69338eeb-c663-4ae4-8c33-36ed9c8b142c', 'fa94be4b-ab42-4517-a4fc-2aa545194950', 'fdcb6bb1-9a17-479e-a105-9c3e40fce384', 'a436dbdc-836e-4559-9ab4-08025454e99a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:46:23.783171 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-459ba1de-41b9-49b5-a3f6-4b4cf252d53d tempest-VolumesExtendTest-927577097 None] Delete snapshot completed successfully. Nov 13 21:46:23.788127 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-459ba1de-41b9-49b5-a3f6-4b4cf252d53d tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-5a739d8b-b4b3-4268-948a-bc9a0c59fc72-delete_snapshot'" released by "delete_snapshot" :: held 4.496s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:46:24.684442 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-ba492a26-f9a2-419a-8b12-8db8aaec8b00-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:46:24.781213 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:25.003250 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:46:25.003670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Volume volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 21:46:25.242101 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] deleting rbd volume volume-ba492a26-f9a2-419a-8b12-8db8aaec8b00 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:46:32.154400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Created reservations ['ea367f26-e263-4fae-9a6d-e646d01ab689', '312817f3-9647-4d30-8e30-12b0f755dc33', 'd257be61-682d-4990-8b2e-075caa510f16', 'd442f8f1-125a-4095-9c20-d160b0089dc3'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:46:32.387122 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:32.409369 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:32.431596 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:46:32.435902 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Deleted volume successfully. Nov 13 21:46:32.497402 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-7e66b104-c56d-4d2a-9764-ab5c79b45e6d tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-ba492a26-f9a2-419a-8b12-8db8aaec8b00-delete_volume'" released by "delete_volume" :: held 7.815s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:46:33.262258 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-2976ac03-04e1-4cc5-9a8b-2c66c4cda802-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:46:33.368889 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:33.708224 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:46:33.927122 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] deleting rbd volume volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:46:40.743847 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-15d405ea-0574-4e71-a3c8-accc67acaf87 req-8f1b041c-b5b1-4f4d-a19d-a5f5ee54a001 tempest-TestVolumeBootPattern-210846747 None] Terminate volume connection completed successfully. Nov 13 21:46:40.744456 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-15d405ea-0574-4e71-a3c8-accc67acaf87 req-8f1b041c-b5b1-4f4d-a19d-a5f5ee54a001 tempest-TestVolumeBootPattern-210846747 None] Deleting attachment b3445f73-73cc-4c3c-ba6f-b4250d0aefec. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 21:46:40.902529 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:46:41.103957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] deleting parent snapshot volume-2976ac03-04e1-4cc5-9a8b-2c66c4cda802.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:46:42.775286 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-c3c21002-3b28-4bb3-b7ec-9a099fae71cd-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 21:46:42.881799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:43.056717 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 21:46:43.127499 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] deleting rbd volume volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 21:46:43.130379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] Created reservations ['40405261-b8b6-4023-b046-1113d9ab7aeb', '3f865dd2-39c4-433d-86c5-532e7121056b', '49d8a858-676f-4027-a722-d276d67c5336', '4ae439ab-4002-42bf-9c81-fb6e2b4f781a'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:46:43.386377 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:43.417869 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:43.440698 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:46:43.444810 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] Deleted volume successfully. Nov 13 21:46:43.519019 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-610c8d70-80fd-4e5c-891b-54f47821b890 tempest-VolumesExtendTest-927577097 None] Lock "b'cinder-2976ac03-04e1-4cc5-9a8b-2c66c4cda802-delete_volume'" released by "delete_volume" :: held 10.257s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:46:47.580805 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 21:46:47.713333 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] deleting parent snapshot volume-c3c21002-3b28-4bb3-b7ec-9a099fae71cd.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 21:46:51.107089 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] Created reservations ['700e55fc-a76b-4e05-90af-a94efada3f55', '9b77d77c-78a5-4ea1-9a62-42b125460e31', '565a05c3-1853-4032-865e-78445a62cfd1', '3e8d30b6-8422-4129-9384-140bc4b55e2f'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 21:46:51.441279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:51.503954 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:46:51.584812 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:46:51.589385 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] Deleted volume successfully. Nov 13 21:46:51.689509 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-85fd23d1-6186-4644-af55-b6c3cbe1ee26 tempest-TestVolumeBootPattern-210846747 None] Lock "b'cinder-c3c21002-3b28-4bb3-b7ec-9a099fae71cd-delete_volume'" released by "delete_volume" :: held 8.910s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 21:47:21.329973 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:47:21.330962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:47:21.404502 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:47:21.533847 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:48:21.329260 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:48:21.329952 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:48:21.355699 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:48:21.393460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:49:21.328370 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:49:21.329734 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:49:21.353610 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:49:21.375430 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:50:21.332400 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:50:21.333082 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:50:21.353962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:50:21.375131 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:51:21.330885 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:51:21.331623 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:51:21.352989 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:51:21.375759 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:52:21.331043 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:52:21.331766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:52:21.353252 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:52:21.374518 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:53:21.330433 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:53:21.331160 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:53:21.353450 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:53:21.374397 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:54:21.330517 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:54:21.331251 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:54:21.351605 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:54:21.373137 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:55:21.333621 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:55:21.334273 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:55:21.364428 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:55:21.388861 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:56:21.334190 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:56:21.334910 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:56:21.367750 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:56:21.398357 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:57:21.334661 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:57:21.335323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:57:21.356616 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:57:21.378004 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:58:21.333442 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:58:21.334215 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:58:21.380340 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:58:21.420030 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 21:59:21.335408 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 21:59:21.336039 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:59:21.359014 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 21:59:21.380559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:00:21.336907 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:00:21.337648 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:00:21.358903 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:00:21.380471 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:01:21.336595 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:01:21.337323 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:01:21.358793 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:01:21.380651 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:02:21.336224 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:02:21.336886 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:02:21.357765 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:02:21.380103 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:03:21.335305 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:03:21.335960 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:03:21.356941 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:03:21.379386 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:04:21.335271 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:04:21.335986 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:04:21.357985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:04:21.379550 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:05:21.335357 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:05:21.336067 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:05:21.356962 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:05:21.379541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:06:21.335633 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:06:21.336279 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:06:21.358975 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:06:21.380282 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:07:21.335752 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:07:21.336468 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:07:21.357979 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:07:21.378955 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:07:47.173980 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 22:07:47.178286 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 22:07:47.181127 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 22:07:47.190682 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Flow 'volume_create_manager' (145f93ae-1972-432f-96fb-9bde77a8b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:07:47.193729 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6605d7-970d-4a76-8815-6cd2a2ecf020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.201534 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 22:07:47.214201 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6605d7-970d-4a76-8815-6cd2a2ecf020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T22:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-661388879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=eed96d8e-219c-4693-9831-f3beb1347b6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7608b55aa7324c33b0406eeedcafcec4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T22:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T22:07:47Z,use_quota=True,user_id='718b1945ca764953ac0929f54daa65c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.216735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02bac57-93be-4ab2-8e65-e908bec8cfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.218799 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02bac57-93be-4ab2-8e65-e908bec8cfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.221122 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90543bc0-8682-41ff-b358-cc87cb43193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.223356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90543bc0-8682-41ff-b358-cc87cb43193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'volume_name': 'volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.225634 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07139166-d71e-4262-a3dc-b60e0ffe980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.231670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07139166-d71e-4262-a3dc-b60e0ffe980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.231670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cf0b59-537c-498b-8069-6820a2cc1e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.231670 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Volume eed96d8e-219c-4693-9831-f3beb1347b6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'volume_size': 1} Nov 13 22:07:47.231670 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] creating volume 'volume-eed96d8e-219c-4693-9831-f3beb1347b6e' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 22:07:47.232247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:07:47.670185 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 22:07:47.670559 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 22:07:47.672678 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cf0b59-537c-498b-8069-6820a2cc1e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.675289 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0068a26-a8cb-423f-be2c-657c40f521f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:07:47.772843 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Volume volume-eed96d8e-219c-4693-9831-f3beb1347b6e (eed96d8e-219c-4693-9831-f3beb1347b6e): created successfully Nov 13 22:07:47.774849 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0068a26-a8cb-423f-be2c-657c40f521f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:07:47.777772 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Flow 'volume_create_manager' (145f93ae-1972-432f-96fb-9bde77a8b676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:07:47.867324 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-ab2de9a0-ffc8-4783-8adb-2c6aedab9be5 tempest-ServerActionsTestJSON-121454775 None] Created volume successfully. Nov 13 22:07:49.086579 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-805866a1-790d-4f75-a775-846cabd6d868 req-e46f4a78-96e2-4624-b9c2-8b682920ef40 tempest-ServerActionsTestJSON-121454775 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 22:07:49.799190 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-805866a1-790d-4f75-a775-846cabd6d868 req-e46f4a78-96e2-4624-b9c2-8b682920ef40 tempest-ServerActionsTestJSON-121454775 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.712s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 22:07:49.800004 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-805866a1-790d-4f75-a775-846cabd6d868 req-e46f4a78-96e2-4624-b9c2-8b682920ef40 tempest-ServerActionsTestJSON-121454775 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 22:07:49.904477 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-805866a1-790d-4f75-a775-846cabd6d868 req-e46f4a78-96e2-4624-b9c2-8b682920ef40 tempest-ServerActionsTestJSON-121454775 None] Connection info returned from driver {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '70a7ca1c-9f76-4cff-94f0-53cd01f3e18b'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 22:07:50.014318 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-805866a1-790d-4f75-a775-846cabd6d868 req-e46f4a78-96e2-4624-b9c2-8b682920ef40 tempest-ServerActionsTestJSON-121454775 None] attachment_update completed successfully. Nov 13 22:08:08.889716 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-f857c5f7-ee64-45af-ba7b-1be7b03e6b45 tempest-ServerActionsTestJSON-121454775 None] Terminate volume connection completed successfully. Nov 13 22:08:08.895839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-f857c5f7-ee64-45af-ba7b-1be7b03e6b45 tempest-ServerActionsTestJSON-121454775 None] Deleting attachment 70a7ca1c-9f76-4cff-94f0-53cd01f3e18b. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 22:08:11.523230 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-5e7dca2c-497c-438e-a10e-43c2ff6536e1 tempest-ServerActionsTestJSON-121454775 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 22:08:12.180812 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-5e7dca2c-497c-438e-a10e-43c2ff6536e1 tempest-ServerActionsTestJSON-121454775 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.657s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 22:08:12.181645 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-5e7dca2c-497c-438e-a10e-43c2ff6536e1 tempest-ServerActionsTestJSON-121454775 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 22:08:12.281575 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-5e7dca2c-497c-438e-a10e-43c2ff6536e1 tempest-ServerActionsTestJSON-121454775 None] Connection info returned from driver {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1eef71a9-ed98-4160-92d3-29dc89fab828'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 22:08:12.398823 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-223860d9-ad37-4a9a-8aa7-9ec7db3ef19f req-5e7dca2c-497c-438e-a10e-43c2ff6536e1 tempest-ServerActionsTestJSON-121454775 None] attachment_update completed successfully. Nov 13 22:08:20.775320 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-c2fd6d23-eaac-4f25-b880-0e954e41daf7 tempest-ServerActionsTestJSON-121454775 None] Terminate volume connection completed successfully. Nov 13 22:08:20.775940 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-c2fd6d23-eaac-4f25-b880-0e954e41daf7 tempest-ServerActionsTestJSON-121454775 None] Deleting attachment 1eef71a9-ed98-4160-92d3-29dc89fab828. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 22:08:23.777650 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-bc30bd2f-0cd9-49d2-9497-fc85e8fc8457 tempest-ServerActionsTestJSON-121454775 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 22:08:24.402500 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-bc30bd2f-0cd9-49d2-9497-fc85e8fc8457 tempest-ServerActionsTestJSON-121454775 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.625s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 22:08:24.403332 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-bc30bd2f-0cd9-49d2-9497-fc85e8fc8457 tempest-ServerActionsTestJSON-121454775 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 22:08:24.509340 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-bc30bd2f-0cd9-49d2-9497-fc85e8fc8457 tempest-ServerActionsTestJSON-121454775 None] Connection info returned from driver {'name': 'volumes/volume-eed96d8e-219c-4693-9831-f3beb1347b6e', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'eed96d8e-219c-4693-9831-f3beb1347b6e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2083c67d-d825-4a7a-bbe1-a21a1393015e'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 22:08:24.627332 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-83193bca-1cd2-4d6a-9d5b-932588c3ad8a req-bc30bd2f-0cd9-49d2-9497-fc85e8fc8457 tempest-ServerActionsTestJSON-121454775 None] attachment_update completed successfully. Nov 13 22:08:32.490619 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-8a7fe898-4324-4533-9b76-42b03a0bdb2b req-3051dbbe-6233-4eeb-b1d1-c23eed974abe tempest-ServerActionsTestJSON-121454775 None] Terminate volume connection completed successfully. Nov 13 22:08:32.491310 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-8a7fe898-4324-4533-9b76-42b03a0bdb2b req-3051dbbe-6233-4eeb-b1d1-c23eed974abe tempest-ServerActionsTestJSON-121454775 None] Deleting attachment 2083c67d-d825-4a7a-bbe1-a21a1393015e. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 22:08:33.593918 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Lock "b'cinder-eed96d8e-219c-4693-9831-f3beb1347b6e-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 22:08:33.683625 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:08:33.820591 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 22:08:33.821058 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Volume volume-eed96d8e-219c-4693-9831-f3beb1347b6e is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 22:08:33.936208 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] deleting rbd volume volume-eed96d8e-219c-4693-9831-f3beb1347b6e {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 22:08:37.047247 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Created reservations ['d1053d5a-9c57-4aca-96ba-eb8e13b9df05', 'a098a8c0-3a4b-44fb-816e-7d6947aa5757', '0b99fc2c-31e8-4cdf-bc14-59482059b95d', '7f74de06-b271-474b-8c32-51f741503d96'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 22:08:37.258314 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:08:37.281390 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:08:37.303353 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:08:37.307621 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Deleted volume successfully. Nov 13 22:08:37.375938 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-2ce619b0-8ecb-4f96-b7a9-8c98a29d9418 tempest-ServerActionsTestJSON-121454775 None] Lock "b'cinder-eed96d8e-219c-4693-9831-f3beb1347b6e-delete_volume'" released by "delete_volume" :: held 3.782s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 22:09:21.335005 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:09:21.335689 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:09:21.356538 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:09:21.407762 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:10:21.337461 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:10:21.338248 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:10:21.366782 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:10:21.391220 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:10:37.676138 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 22:10:37.679766 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 22:10:37.680275 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 22:10:37.692359 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Flow 'volume_create_manager' (00c86c3a-d7b4-4723-b92d-8c837fefbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:10:37.695796 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ed1a0c-e324-4461-95ce-7a4a6742a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:37.701577 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 22:10:37.714092 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ed1a0c-e324-4461-95ce-7a4a6742a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T22:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-753641948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f4db566b-14ab-4f38-8aee-cae16ad51b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d82cb7d594e4155a0ffe23a7875e409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T22:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T22:10:38Z,use_quota=True,user_id='e4694458262a4606b671b046baa853b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:37.726124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d380e-edd9-4461-9101-c06994472f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:37.726124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435d380e-edd9-4461-9101-c06994472f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:37.726124 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130b610-348b-432d-9b69-dd6caffaa0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:37.726458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1130b610-348b-432d-9b69-dd6caffaa0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4db566b-14ab-4f38-8aee-cae16ad51b05', 'volume_name': 'volume-f4db566b-14ab-4f38-8aee-cae16ad51b05', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:37.726458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6142a2-0ae9-4c69-8576-15367ac1e403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:37.728062 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb6142a2-0ae9-4c69-8576-15367ac1e403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:37.730191 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed86821-11be-4636-bf73-88faadfce21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:37.730946 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Volume f4db566b-14ab-4f38-8aee-cae16ad51b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4db566b-14ab-4f38-8aee-cae16ad51b05', 'volume_size': 1} Nov 13 22:10:37.731335 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] creating volume 'volume-f4db566b-14ab-4f38-8aee-cae16ad51b05' {{(pid=129109) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:977}} Nov 13 22:10:37.732325 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:10:38.322609 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 22:10:38.322976 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 22:10:38.324957 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed86821-11be-4636-bf73-88faadfce21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4db566b-14ab-4f38-8aee-cae16ad51b05', 'volume_size': 1}' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:38.327238 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9072c-f2b4-4cc2-81a8-b86cc291cd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:10:38.400366 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Volume volume-f4db566b-14ab-4f38-8aee-cae16ad51b05 (f4db566b-14ab-4f38-8aee-cae16ad51b05): created successfully Nov 13 22:10:38.402289 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aa9072c-f2b4-4cc2-81a8-b86cc291cd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:10:38.405212 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Flow 'volume_create_manager' (00c86c3a-d7b4-4723-b92d-8c837fefbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:10:38.487637 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-9e561911-86f2-4d50-a026-ae0ce508065e tempest-TestMinimumBasicScenario-1162355228 None] Created volume successfully. Nov 13 22:10:39.734693 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-81930668-a564-4776-9247-afef1bd1e71a req-88ed6201-382e-4420-8a99-3bfca9318bc7 tempest-TestMinimumBasicScenario-1162355228 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 22:10:40.416225 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-81930668-a564-4776-9247-afef1bd1e71a req-88ed6201-382e-4420-8a99-3bfca9318bc7 tempest-TestMinimumBasicScenario-1162355228 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.681s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 22:10:40.417506 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-81930668-a564-4776-9247-afef1bd1e71a req-88ed6201-382e-4420-8a99-3bfca9318bc7 tempest-TestMinimumBasicScenario-1162355228 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f4db566b-14ab-4f38-8aee-cae16ad51b05', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': 'f4db566b-14ab-4f38-8aee-cae16ad51b05', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 22:10:40.508639 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-81930668-a564-4776-9247-afef1bd1e71a req-88ed6201-382e-4420-8a99-3bfca9318bc7 tempest-TestMinimumBasicScenario-1162355228 None] Connection info returned from driver {'name': 'volumes/volume-f4db566b-14ab-4f38-8aee-cae16ad51b05', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f4db566b-14ab-4f38-8aee-cae16ad51b05', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '32528dbb-60d0-47f4-ba02-e8a0321f9bbf'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 22:10:40.628653 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-81930668-a564-4776-9247-afef1bd1e71a req-88ed6201-382e-4420-8a99-3bfca9318bc7 tempest-TestMinimumBasicScenario-1162355228 None] attachment_update completed successfully. Nov 13 22:11:21.337169 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:11:21.338194 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:11:21.361896 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:11:21.383478 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:12:03.497505 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-84e9a18a-722d-4801-86be-59a400a4fd31 req-5cfa73d6-cde6-4732-a224-62c6526df7da tempest-TestMinimumBasicScenario-1162355228 None] Terminate volume connection completed successfully. Nov 13 22:12:03.498362 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-84e9a18a-722d-4801-86be-59a400a4fd31 req-5cfa73d6-cde6-4732-a224-62c6526df7da tempest-TestMinimumBasicScenario-1162355228 None] Deleting attachment 32528dbb-60d0-47f4-ba02-e8a0321f9bbf. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 22:12:04.119736 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Lock "b'cinder-f4db566b-14ab-4f38-8aee-cae16ad51b05-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 22:12:04.200081 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:12:04.343568 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 22:12:04.344099 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Volume volume-f4db566b-14ab-4f38-8aee-cae16ad51b05 is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 22:12:04.424297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] deleting rbd volume volume-f4db566b-14ab-4f38-8aee-cae16ad51b05 {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 22:12:07.566852 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Created reservations ['283f1d61-a121-44d7-97ee-9940fce05464', 'c3af3048-5b7f-4642-b011-04e5366f2d0c', '602cfa76-ce95-4b67-9dd7-ea4ff86483f5', '9330cee4-b4b1-4ae7-a2ab-236bcd4352ab'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 22:12:07.744216 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:12:07.766308 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:12:07.790031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:12:07.794122 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Deleted volume successfully. Nov 13 22:12:07.854543 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-f2860d7e-4a32-44ca-b2b9-2e47a86af69d tempest-TestMinimumBasicScenario-1162355228 None] Lock "b'cinder-f4db566b-14ab-4f38-8aee-cae16ad51b05-delete_volume'" released by "delete_volume" :: held 3.735s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 22:12:21.340146 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:12:21.342653 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:12:21.365220 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:12:21.402128 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:13:21.337348 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:13:21.338113 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:13:21.359735 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:13:21.383967 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:14:21.338765 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:14:21.339500 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:14:21.360554 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:14:21.382315 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:15:21.338027 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:15:21.339408 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:15:21.397287 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:15:21.454230 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:16:21.337384 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:16:21.338100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:16:21.358856 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:16:21.381897 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:17:21.338697 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:17:21.339422 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:17:21.377117 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:17:21.403541 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:18:21.338970 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:18:21.339693 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:18:21.360484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:18:21.382975 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:19:21.338024 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:19:21.338807 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:19:21.367172 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:19:21.399987 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:20:21.337870 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:20:21.337870 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:20:21.359912 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:20:21.394108 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:21:21.339704 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:21:21.340379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:21:21.362170 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:21:21.384036 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:22:21.339400 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:22:21.340092 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:22:21.362656 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:22:21.384392 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:23:21.339385 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:23:21.340539 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:23:21.361985 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:23:21.388238 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:24:21.343605 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:24:21.344775 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:24:21.366814 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:24:21.452371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:25:06.229125 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=129109) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 13 22:25:06.233348 ncdv-master-1 cinder-volume[129109]: WARNING stevedore.named [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 13 22:25:06.233838 ncdv-master-1 cinder-volume[129109]: WARNING castellan.key_manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 13 22:25:06.247650 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Flow 'volume_create_manager' (af951659-fe96-4f3f-84ee-8a63d5662f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:25:06.250949 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42886086-83f5-49e9-b4a0-8082f0c0d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:06.257097 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_db.sqlalchemy.engines [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129109) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 13 22:25:06.269012 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42886086-83f5-49e9-b4a0-8082f0c0d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-13T22:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-246377954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=94b0ea9d-8a45-45fc-af7a-ca20dba44e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0845e4d245d5407f9c393289fc1bb22e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-13T22:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-13T22:25:06Z,use_quota=True,user_id='ea0f87c5da7d4122a48e94650e7f8989',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b5d1537-c336-401c-97ba-43771254616f),volume_type_id=7b5d1537-c336-401c-97ba-43771254616f)' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:06.271482 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177b840d-001c-4d44-b8c8-67cbcf76484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:06.274983 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177b840d-001c-4d44-b8c8-67cbcf76484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:06.277367 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403ad1b6-e23d-4bbd-93b4-00aeb6449311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:06.355379 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403ad1b6-e23d-4bbd-93b4-00aeb6449311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'volume_name': 'volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:06.357771 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f2584d-0960-459d-88ea-9759ba6da913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:06.359894 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f2584d-0960-459d-88ea-9759ba6da913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:06.362100 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f91cfb-936e-4388-a72c-490f8c97d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:06.362895 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Volume 94b0ea9d-8a45-45fc-af7a-ca20dba44e8b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 13 22:25:06.363488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Cloning 94b0ea9d-8a45-45fc-af7a-ca20dba44e8b from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 at location (None, None). {{(pid=129109) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 13 22:25:06.372245 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 22:25:06.433050 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 22, 25, 6, 376152)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 22:25:06.433481 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 22:25:06.433881 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Found cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 13 22:25:06.439561 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Lock "b'cinder-33752eb4-10ed-4e9e-a42e-f957ddc6e2a6'" released by "_prepare_image_cache_entry" :: held 0.067s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 22:25:06.440455 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Attempting to retrieve cache entry for image = 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 on host ncdv-master-1@ceph#ceph. {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 13 22:25:06.446595 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Found image-volume cache entry: {'id': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'volume_id': '59d2d75f-7538-4ca4-b73a-d76015a0a201', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46), 'last_used': datetime.datetime(2021, 11, 13, 22, 25, 6, 443821)}. {{(pid=129109) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 13 22:25:06.449077 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.image.cache [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Image-volume cache entry image_update_at = 2021-11-13 20:55:46+00:00, requested image updated_at = 2021-11-13 20:55:46+00:00. {{(pid=129109) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 13 22:25:06.449077 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Creating from source image-volume 59d2d75f-7538-4ca4-b73a-d76015a0a201 {{(pid=129109) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 13 22:25:06.458328 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:25:06.593051 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] creating snapshot='volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b.clone_snap' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:724}} Nov 13 22:25:07.893076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] cloning 'volume-59d2d75f-7538-4ca4-b73a-d76015a0a201@volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b.clone_snap' to 'volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b' {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:730}} Nov 13 22:25:08.989423 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Volume volume-18c32b32-209d-450d-8539-a9709a62ccee.deleted is not a clone. {{(pid=129109) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1124}} Nov 13 22:25:08.990488 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:859}} Nov 13 22:25:08.991357 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=129109) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:868}} Nov 13 22:25:09.294625 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] clone created successfully {{(pid=129109) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:802}} Nov 13 22:25:09.295231 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.volume_utils [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Marking volume 94b0ea9d-8a45-45fc-af7a-ca20dba44e8b as bootable. {{(pid=129109) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 13 22:25:09.353599 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Copying metadata from image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 to 94b0ea9d-8a45-45fc-af7a-ca20dba44e8b. {{(pid=129109) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 13 22:25:09.354031 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Creating volume glance metadata for volume 94b0ea9d-8a45-45fc-af7a-ca20dba44e8b backed by image 33752eb4-10ed-4e9e-a42e-f957ddc6e2a6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=129109) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 13 22:25:09.477460 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f91cfb-936e-4388-a72c-490f8c97d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'volume_size': 1, 'image_id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '157f758fbcb14314bd6797d15d1e7597', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '33752eb4-10ed-4e9e-a42e-f957ddc6e2a6', 'created_at': datetime.datetime(2021, 11, 13, 20, 55, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 13, 20, 55, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33752eb4-10ed-4e9e-a42e-f957ddc6e2a6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:09.480897 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81284e4a-cfa2-4860-b2f2-19a538c80fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 13 22:25:09.567262 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.flows.manager.create_volume [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Volume volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b (94b0ea9d-8a45-45fc-af7a-ca20dba44e8b): created successfully Nov 13 22:25:09.569294 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81284e4a-cfa2-4860-b2f2-19a538c80fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=129109) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 13 22:25:09.572798 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Flow 'volume_create_manager' (af951659-fe96-4f3f-84ee-8a63d5662f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=129109) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 13 22:25:09.675320 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [None req-5f68c8a1-0467-4b70-96ef-7ace1b640467 tempest-TestShelveInstance-1241219775 None] Created volume successfully. Nov 13 22:25:16.571234 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-9ba17aae-f2d4-47b5-bf33-97b2a09666e2 req-f57610c1-1a02-49fe-8902-02118389b9d5 tempest-TestShelveInstance-1241219775 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 13 22:25:17.258996 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_concurrency.processutils [req-9ba17aae-f2d4-47b5-bf33-97b2a09666e2 req-f57610c1-1a02-49fe-8902-02118389b9d5 tempest-TestShelveInstance-1241219775 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=129109) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 13 22:25:17.259766 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-9ba17aae-f2d4-47b5-bf33-97b2a09666e2 req-f57610c1-1a02-49fe-8902-02118389b9d5 tempest-TestShelveInstance-1241219775 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '575ec9f0-064f-427c-bf35-72b83580d1d1', 'volume_id': '94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'discard': True}} {{(pid=129109) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1526}} Nov 13 22:25:17.361149 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-9ba17aae-f2d4-47b5-bf33-97b2a09666e2 req-f57610c1-1a02-49fe-8902-02118389b9d5 tempest-TestShelveInstance-1241219775 None] Connection info returned from driver {'name': 'volumes/volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'hosts': ['10.222.0.20'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '94b0ea9d-8a45-45fc-af7a-ca20dba44e8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed84047f-02c0-4b38-a4ca-ef4b37b15703'} {{(pid=129109) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 13 22:25:17.471195 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-9ba17aae-f2d4-47b5-bf33-97b2a09666e2 req-f57610c1-1a02-49fe-8902-02118389b9d5 tempest-TestShelveInstance-1241219775 None] attachment_update completed successfully. Nov 13 22:25:21.347569 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:25:21.348620 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:25:21.374991 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:25:21.404371 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:26:21.349834 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:26:21.351059 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:26:21.375458 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:26:21.397776 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:27:21.354005 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:27:21.354685 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:27:21.376220 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:27:21.398649 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:28:21.354426 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:28:21.355544 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:28:21.377297 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:28:21.398852 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:29:00.663590 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-fd895fe0-dbe8-4ec3-8e1f-494339cd7aba tempest-TestShelveInstance-1241219775 None] Terminate volume connection completed successfully. Nov 13 22:29:00.664225 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.manager [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-fd895fe0-dbe8-4ec3-8e1f-494339cd7aba tempest-TestShelveInstance-1241219775 None] Deleting attachment ed84047f-02c0-4b38-a4ca-ef4b37b15703. {{(pid=129109) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 13 22:29:00.967376 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] Lock "b'cinder-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 13 22:29:01.044490 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:29:01.254696 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] volume has no backup snaps {{(pid=129109) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1101}} Nov 13 22:29:01.336076 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] deleting rbd volume volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1244}} Nov 13 22:29:05.904410 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] volume is a clone so cleaning references {{(pid=129109) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1265}} Nov 13 22:29:06.047324 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] deleting parent snapshot volume-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b.clone_snap {{(pid=129109) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1157}} Nov 13 22:29:08.849400 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.quota [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] Created reservations ['42f477dd-5cfd-45c4-8238-9a0c3e385177', '7039f5e0-9c46-4ba1-bc39-3c0c995c04c9', '37a2aa27-1982-4bdb-86c1-7ec71b09773b', 'df199b06-cae4-48a1-ae14-0737de2b3554'] {{(pid=129109) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 13 22:29:09.029439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:29:09.083450 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:29:09.150230 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:29:09.154899 ncdv-master-1 cinder-volume[129109]: INFO cinder.volume.manager [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] Deleted volume successfully. Nov 13 22:29:09.233484 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.coordination [req-19a55196-8f6b-43cd-8c6f-efe6d81ebdfe req-f0fabaf5-6a7c-4b02-b271-5e213ad693f4 tempest-TestShelveInstance-1241219775 None] Lock "b'cinder-94b0ea9d-8a45-45fc-af7a-ca20dba44e8b-delete_volume'" released by "delete_volume" :: held 8.266s {{(pid=129109) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 13 22:29:21.354344 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:29:21.354998 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:29:21.427561 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:29:21.487695 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:30:21.353363 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:30:21.353937 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:30:21.374810 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:30:21.459159 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:31:21.353768 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:31:21.354356 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:31:21.375833 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:31:21.397615 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:32:21.353193 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:32:21.353969 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:32:21.379116 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:32:21.405972 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:33:21.351229 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:33:21.351907 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:33:21.372133 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:33:21.394252 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:34:21.349503 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:34:21.350147 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:34:21.375599 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:34:21.402438 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:35:21.347259 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:35:21.347913 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:35:21.378497 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:35:21.400373 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:36:21.346386 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:36:21.347034 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:36:21.368608 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:36:21.389223 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:37:21.343944 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:37:21.344608 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:37:21.365609 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:37:21.390439 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:38:21.347721 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:38:21.348370 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:38:21.368899 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:38:21.390337 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:39:21.346711 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:39:21.347878 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:39:21.368839 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:39:21.390411 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:40:21.345435 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:40:21.346116 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:40:21.367167 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:40:21.388090 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:41:21.343755 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:41:21.344457 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:41:21.365120 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:41:21.387195 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 13 22:42:21.343275 ncdv-master-1 cinder-volume[129109]: DEBUG oslo_service.periodic_task [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=129109) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 13 22:42:21.343944 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:42:21.365065 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.volume.drivers.rbd [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=129109) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 13 22:42:21.386700 ncdv-master-1 cinder-volume[129109]: DEBUG cinder.manager [None req-4a0b43de-ce5a-4762-89d5-df2e68966c2a None None] Notifying Schedulers of capabilities ... {{(pid=129109) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}