-- Logs begin at Sat 2022-08-27 20:01:14 UTC, end at Sat 2022-08-27 22:28:52 UTC. --
Aug 27 20:39:55.858409 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Aug 27 20:39:59.251397 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=133218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}}
Aug 27 20:39:59.252395 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=133218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}}
Aug 27 20:39:59.252395 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=133218) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}}
Aug 27 20:39:59.683928 ncdv-master-1 cinder-volume[133218]: INFO dbcounter [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Registered counter for database cinder
Aug 27 20:39:59.704548 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_db.sqlalchemy.engines [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 20:39:59.713461 ncdv-master-1 cinder-volume[133218]: DEBUG dbcounter [-] [133218] Writer thread running {{(pid=133218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 27 20:40:00.008977 ncdv-master-1 cinder-volume[133218]: INFO cinder.rpc [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 27 20:40:00.014382 ncdv-master-1 cinder-volume[133218]: INFO cinder.rpc [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 27 20:40:00.031396 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_db.sqlalchemy.engines [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 20:40:00.103260 ncdv-master-1 cinder-volume[133218]: INFO cinder.volume.manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Determined volume DB was empty at startup.
Aug 27 20:40:00.103918 ncdv-master-1 cinder-volume[133218]: DEBUG cinder.volume.manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=133218) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Aug 27 20:40:00.112736 ncdv-master-1 cinder-volume[133218]: INFO cinder.volume.manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 27 20:40:00.113515 ncdv-master-1 cinder-volume[133218]: WARNING stevedore.named [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 27 20:40:00.114010 ncdv-master-1 cinder-volume[133218]: WARNING castellan.key_manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 27 20:40:00.115137 ncdv-master-1 cinder-volume[133218]: WARNING cinder.keymgr.conf_key_mgr [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 27 20:40:00.131141 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_db.sqlalchemy.engines [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 20:40:00.140332 ncdv-master-1 cinder-volume[133218]: INFO cinder.rpc [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 27 20:40:00.144708 ncdv-master-1 cinder-volume[133218]: INFO cinder.rpc [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Aug 27 20:40:00.145882 ncdv-master-1 cinder-volume[133218]: WARNING stevedore.named [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 27 20:40:00.146361 ncdv-master-1 cinder-volume[133218]: WARNING castellan.key_manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 27 20:40:00.148482 ncdv-master-1 cinder-volume[133218]: INFO cinder.volume.manager [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Aug 27 20:40:00.155293 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_db.sqlalchemy.engines [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133218) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 20:40:00.175466 ncdv-master-1 cinder-volume[133218]: INFO oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Starting 1 workers
Aug 27 20:40:00.180806 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Started child 133391 {{(pid=133218) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Aug 27 20:40:00.181997 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Full set of CONF: {{(pid=133218) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Aug 27 20:40:00.182515 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ******************************************************************************** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Aug 27 20:40:00.182980 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Configuration options gathered from: {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Aug 27 20:40:00.183501 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Aug 27 20:40:00.184284 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Aug 27 20:40:00.184720 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ================================================================================ {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Aug 27 20:40:00.185597 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] allow_availability_zone_fallback = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.186139 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] allow_compression_on_image_upload = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.186776 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] allowed_direct_url_schemes     = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.187294 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] api_rate_limit                 = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.187621 ncdv-master-1 cinder-volume[133391]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Aug 27 20:40:00.188460 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] auth_strategy                  = keystone {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.189042 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] az_cache_duration              = 3600 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.189576 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_availability_zone      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.190266 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_host                   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.190838 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_name                   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.191406 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_stats_polling_interval = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.191961 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backup_api_class               = cinder.backup.api.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.192561 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.193101 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backup_name_template           = backup-%s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.193688 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backup_use_same_host           = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.194191 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backup_use_temp_snapshot       = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.194737 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] chap_password                  = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.195231 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] chap_username                  =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.195847 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.196406 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_internal_tenant_project_id = 6988df1452994470ae9cc2548d45e0d7 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.196937 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_internal_tenant_user_id = 52aaf7f52367489f8764d89c305d7a2e {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.197442 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cloned_volume_same_az          = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.197964 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cluster                        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.198504 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] compression_format             = gzip {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.199070 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] compute_api_class              = cinder.compute.nova.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.199677 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] config_dir                     = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.200279 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.200914 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] config_source                  = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.201433 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.201989 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] control_exchange               = openstack {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.202550 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] debug                          = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.203123 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] default_availability_zone      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.203643 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] default_group_type             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.204475 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.205226 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] default_volume_type            = ceph {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.205829 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_client_cert             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.206347 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_client_cert_key         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.206853 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_data_namespace          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.207361 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_ssl_cert_path           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.207903 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_ssl_cert_verify         = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.208399 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] driver_use_ssl                 = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.208928 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] enable_force_upload            = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.210512 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] enable_new_services            = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.211480 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] enable_unsupported_driver      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.212407 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] enabled_backends               = ['ceph'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.213062 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] enforce_multipath_for_image_xfer = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.213621 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] filter_function                = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.214180 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_api_insecure            = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.214758 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_api_servers             = ['http://10.222.0.40/image'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.215309 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_api_ssl_compression     = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.215889 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_ca_certificates_file    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.216480 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_catalog_info            = image:glance:publicURL {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.217020 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_certfile                = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.217736 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.218308 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_keyfile                 = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.218854 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_num_retries             = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.219439 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] glance_request_timeout         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.220297 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] goodness_function              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.221044 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] graceful_shutdown_timeout      = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.221605 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] group_api_class                = cinder.group.api.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.222122 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] host                           = ncdv-master-1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.222710 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.223486 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_compress_on_upload       = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.224090 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_conversion_address_space_limit = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.225362 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_conversion_cpu_limit     = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.226135 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.226734 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_conversion_disable       = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.227281 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_upload_use_cinder_backend = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.227875 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_upload_use_internal_tenant = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.228433 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_volume_cache_enabled     = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.229000 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_volume_cache_max_count   = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.229567 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] image_volume_cache_max_size_gb = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.230115 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] init_host_max_objects_retrieval = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.230831 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] instance_format                = [instance: %(uuid)s]  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.231092 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Starting volume driver RBDDriver (1.2.0)
Aug 27 20:40:00.231669 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.232257 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iscsi_iotype                   = fileio {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.232859 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.233212 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iscsi_secondary_ip_addresses   = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.233783 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iscsi_target_flags             =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.234347 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iscsi_write_cache              = on {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.234899 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iser_helper                    = tgtadm {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.235713 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iser_ip_address                = 10.222.0.40 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.236327 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iser_port                      = 3260 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.236893 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.237486 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_config_append              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.238054 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.238608 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_dir                        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.239233 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_file                       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.240016 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_options                    = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.240596 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_rotate_interval            = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.241412 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_rotate_interval_type       = days {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.242036 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] log_rotation_type              = none {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.242722 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.242972 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.243611 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.244023 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.244383 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.244853 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] max_age                        = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.245270 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] max_logfile_count              = 30 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.245681 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] max_logfile_size_mb            = 200 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.246340 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] max_over_subscription_ratio    = 20.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.246930 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] message_reap_interval          = 86400 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.247515 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] message_ttl                    = 2592000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.248068 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] migration_create_volume_timeout_secs = 300 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.248664 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] monkey_patch                   = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.249214 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] monkey_patch_modules           = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.249751 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] my_ip                          = 10.222.0.40 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.250291 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] no_snapshot_gb_quota           = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.250889 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] num_iser_scan_tries            = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.251635 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] num_shell_tries                = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.252219 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] num_volume_device_scan_tries   = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.253226 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] nvmet_ns_id                    = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.253769 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] nvmet_port_id                  = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.254352 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_max_limit                = 1000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.255102 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_ext_list          = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.255616 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.256040 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.256475 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_listen_port       = 8776 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.256886 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_use_ssl           = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.257343 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] osapi_volume_workers           = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.257755 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] per_volume_size_limit          = -1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.258160 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] periodic_fuzzy_delay           = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.258571 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] periodic_interval              = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.259028 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.259473 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] public_endpoint                = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.259880 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] publish_errors                 = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.260307 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_backup_gigabytes         = 1000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.260732 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_backups                  = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.261154 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_consistencygroups        = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.261777 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.262222 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_gigabytes                = 1000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.262632 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_groups                   = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.263155 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_snapshots                = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.263580 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] quota_volumes                  = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.264005 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] rate_limit_burst               = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.264438 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] rate_limit_except_level        = CRITICAL {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.264861 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] rate_limit_interval            = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.265269 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] reinit_driver_count            = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.265684 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] replication_device             = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.266085 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] report_discard_supported       = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.266486 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] report_interval                = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.267021 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] reservation_clean_interval     = 86400 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.267460 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] reservation_expire             = 86400 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.267876 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] reserved_percentage            = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.268311 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.268735 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.269198 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] rpc_response_timeout           = 120 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.269711 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] run_external_periodic_tasks    = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.270099 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.270695 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] scst_target_driver             = iscsi {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.271166 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] scst_target_iqn_name           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.271916 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_down_time              = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.272424 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] snapshot_name_template         = snapshot-%s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.272923 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] snapshot_same_host             = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.273440 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] split_loggers                  = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.273877 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] state_path                     = /opt/stack/data/cinder {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.274390 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] storage_availability_zone      = nova {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.274904 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] storage_protocol               = iSCSI {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.275457 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] syslog_log_facility            = LOG_USER {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.275951 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] target_helper                  = lioadm {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.276565 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] target_ip_address              = 10.222.0.40 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.277082 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] target_port                    = 3260 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.277565 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.278089 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] target_protocol                = iscsi {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.278568 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] trace_flags                    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.279080 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.279620 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] transport_url                  = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.280168 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] until_refresh                  = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.280715 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_chap_auth                  = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.281237 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_default_quota_class        = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.281877 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_eventlog                   = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.282421 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_journal                    = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.282966 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_json                       = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.283613 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_multipath_for_image_xfer   = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.284148 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_stderr                     = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.284690 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] use_syslog                     = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.285260 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] verify_glance_signatures       = enabled {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.285900 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_api_class               = cinder.volume.api.API {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.286424 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_backend_name            = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.287076 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_clear                   = zero {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.287626 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_clear_ionice            = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.288351 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_clear_size              = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.288891 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.289465 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_copy_bps_limit          = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.290003 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_dd_blocksize            = 1M {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.290691 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.291052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.291494 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_name_template           = volume-%s {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.292158 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_service_inithost_offload = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.292702 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volume_usage_audit_period      = month {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.293316 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.293842 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] watch_log_file                 = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.294363 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] zoning_mode                    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 27 20:40:00.295017 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.295616 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.296173 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_concurrency.disable_process_locking = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.296833 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.297424 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.297945 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.298474 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.299033 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.299579 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.300202 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.admin_password = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.300759 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.301325 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.admin_token = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.312095 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.admin_user  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.312252 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.312597 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.312993 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_port   = 35357 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.313391 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_protocol = https {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.313822 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_section = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.314239 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_type   = password {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.314627 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_uri    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.314987 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.auth_version = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.315357 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.cache       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.318861 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.320327 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.certfile    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.320731 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.delay_auth_decision = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.321150 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.321517 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.http_connect_timeout = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.321883 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.322241 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.identity_uri = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.322603 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.include_service_catalog = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.322965 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.insecure    = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.324955 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.interface   = public {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.324955 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.keyfile     = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.324955 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.324955 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.326057 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.326182 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.326791 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.327319 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.327762 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.328318 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.328903 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.329269 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.region_name = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.329653 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.330012 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.service_token_roles_required = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.330400 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.service_type = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.330758 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.token_cache_time = 300 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.331127 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.331607 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.backend                  = dogpile.cache.null {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.332002 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.backend_argument         = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.332374 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.config_prefix            = cache.oslo {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.333367 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.dead_timeout             = 60.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.334337 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.debug_cache_backend      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.334846 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.enable_retry_client      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.335412 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.enable_socket_keepalive  = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.336070 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.enabled                  = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.337284 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.expiration_time          = 600 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.338056 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.hashclient_retry_attempts = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.338795 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.339323 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_dead_retry      = 300 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.339727 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_password        =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.340112 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.340475 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.340830 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_pool_maxsize    = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.341183 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.341576 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_sasl_enabled    = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.341970 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.342355 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.342722 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.memcache_username        =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.343087 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.proxies                  = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.343470 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.retry_attempts           = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.343830 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.retry_delay              = 0.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.344179 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.socket_keepalive_count   = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.344910 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.socket_keepalive_idle    = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.345265 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.socket_keepalive_interval = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.345609 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.tls_allowed_ciphers      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.345952 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.tls_cafile               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.346463 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.tls_certfile             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.346842 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.tls_enabled              = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.347200 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cache.tls_keyfile              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.347956 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] coordination.backend_url       = etcd3+http://10.222.0.40:2379 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.349290 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.backend               = sqlalchemy {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.349816 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.connection            = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.350230 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.connection_debug      = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.350755 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.connection_parameters =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.351144 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.connection_recycle_time = 3600 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.351536 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.connection_trace      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.351891 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.db_inc_retry_interval = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.352240 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.db_max_retries        = 20 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.352609 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.db_max_retry_interval = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.352958 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.db_retry_interval     = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.353334 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.max_overflow          = 50 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.353708 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.max_pool_size         = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.354058 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.max_retries           = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.354406 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.mysql_enable_ndb      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.354769 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.355125 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.pool_timeout          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.355535 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.retry_interval        = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.355666 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.356302 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.slave_connection      = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.356826 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.sqlite_synchronous    = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.357340 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] database.use_db_reconnect      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.357879 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.enforce_new_defaults = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.358405 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.enforce_scope      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.359160 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.policy_default_rule = default {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.359744 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.360325 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.policy_file        = policy.yaml {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.360864 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.361388 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.361887 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.362407 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.362917 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.363535 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.connection_string     = messaging:// {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.364149 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.enabled               = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.365354 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.es_doc_type           = notification {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.365874 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.es_scroll_size        = 10000 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.366561 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.es_scroll_time        = 2m {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.367087 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.filter_error_trace    = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.367632 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.368148 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.sentinel_service_name = mymaster {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.368701 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.socket_timeout        = 0.1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.369329 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] profiler.trace_sqlalchemy      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.369872 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] os_brick.lock_path             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.370442 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.capabilities   = [21] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.370995 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.group          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.371386 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.helper_command = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.371731 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.372093 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.372463 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] privsep_osbrick.user           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.372871 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.373217 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.group         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.373568 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.helper_command = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.373922 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.374294 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.374638 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] cinder_sys_admin.user          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.375024 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.auth_section      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.375403 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.auth_type         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.375752 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.cafile            = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.376161 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.certfile          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.376582 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.collect_timing    = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.376929 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.insecure          = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.377273 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.keyfile           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.377619 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.send_service_user_token = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.377969 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.split_loggers     = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.378332 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] service_user.timeout           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.378754 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.backend_availability_zone = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.379105 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.380084 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.380482 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.chap_password = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.380851 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.chap_username =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.381223 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.381584 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.381947 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.382295 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_client_cert = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.382647 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_client_cert_key = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.383000 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_data_namespace = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.383370 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.383730 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.384080 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.driver_use_ssl = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.384435 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.enable_deferred_deletion = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.384791 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.enable_unsupported_driver = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.385139 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.385503 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.extra_capabilities = {} {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.385847 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.filter_function = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.386206 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.goodness_function = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.386568 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.386920 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.387269 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.387672 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.388020 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.388535 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.388928 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iscsi_iotype  = fileio {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.389543 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.391016 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iscsi_target_flags =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.391930 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iscsi_write_cache = on {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.392643 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iser_helper   = tgtadm {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.393207 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iser_ip_address = 10.222.0.40 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.393571 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iser_port     = 3260 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.393937 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.394313 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.394689 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.395076 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.num_shell_tries = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.396081 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.396446 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.396803 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.nvmet_port_id = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.397380 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rados_connect_timeout = -1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.397900 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rados_connection_interval = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.398262 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rados_connection_retries = 3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.398653 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_ceph_conf =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.399029 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_cluster_name = ceph {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.399432 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.399844 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.400204 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.400748 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_pool      = rbd {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.401235 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_secret_uuid = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.401789 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.402399 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.rbd_user      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.403213 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.replication_connect_timeout = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.403742 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.replication_device = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.404265 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.report_discard_supported = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.404877 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.405402 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.reserved_percentage = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.405935 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.scst_target_driver = iscsi {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.408183 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.scst_target_iqn_name = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.408571 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.storage_protocol = iSCSI {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.408949 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.409329 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.target_helper = tgtadm {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.409831 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.target_ip_address = 10.222.0.40 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.410193 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.target_port   = 3260 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.410586 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.411717 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.target_protocol = iscsi {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.412086 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.trace_flags   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.412448 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.unique_fqdn_network = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.412805 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.use_chap_auth = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.413161 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.414163 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_backend_name = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.415022 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_clear  = zero {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.415567 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_clear_ionice = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.416103 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_clear_size = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.416502 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.416884 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.417282 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.417658 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.418115 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.418208 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.driver [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Driver hasn't implemented _init_vendor_properties()
Aug 27 20:40:00.418518 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_reports.file_event_handler = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.418623 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.driver [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f60509cb-0788-4b7d-926f-6a9af5c8f250:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133391) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Aug 27 20:40:00.418908 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.419283 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_reports.log_dir           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.419705 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.backend_availability_zone = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.420067 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.backend_host              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.420569 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.backend_native_threads_pool_size = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.420946 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.backup_use_temp_snapshot  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.421300 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.chap_password             = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.421650 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.chap_username             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.422014 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.chiscsi_conf              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.422358 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.deferred_deletion_delay   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.422713 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.deferred_deletion_purge_interval = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.423068 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_client_cert        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.423445 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_client_cert_key    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.423799 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_data_namespace     = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.424166 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_ssl_cert_path      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.424510 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_ssl_cert_verify    = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.424855 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.driver_use_ssl            = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.425204 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.enable_deferred_deletion  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.425548 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.enable_unsupported_driver = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.425901 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.426430 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.extra_capabilities        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.427534 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.filter_function           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.427906 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.goodness_function         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.428260 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iet_conf                  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.428611 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.image_upload_use_cinder_backend = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.428959 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.image_upload_use_internal_tenant = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.429337 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.image_volume_cache_enabled = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.429685 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.image_volume_cache_max_count = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.430035 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.image_volume_cache_max_size_gb = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.430380 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iscsi_iotype              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.430730 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.431082 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iscsi_target_flags        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.431446 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iscsi_write_cache         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.431978 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iser_helper               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.432484 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iser_ip_address           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.433369 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iser_port                 = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.434326 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.iser_target_prefix        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.435184 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.max_over_subscription_ratio = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.435733 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.num_iser_scan_tries       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.436248 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.num_shell_tries           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.436756 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.num_volume_device_scan_tries = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.437269 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.nvmet_ns_id               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.437778 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.nvmet_port_id             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.438316 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rados_connect_timeout     = -1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.438825 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rados_connection_interval = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.439327 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rados_connection_retries  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.439897 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.440163 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_db.sqlalchemy.engines [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=133391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 20:40:00.440590 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_cluster_name          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.441093 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.441619 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.442514 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_max_clone_depth       = 5 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.443498 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_pool                  = volumes {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.444020 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_secret_uuid           = 258cf4ee-ed22-4beb-8f24-21132fbd771d {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.444546 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_store_chunk_size      = 4 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.445058 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.rbd_user                  = cinder {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.445663 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.replication_connect_timeout = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.446053 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writer thread running {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 27 20:40:00.446353 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.replication_device        = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.446863 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.report_discard_supported  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.447380 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.report_dynamic_total_capacity = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.447891 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.reserved_percentage       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.448387 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.scst_target_driver        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.448876 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.scst_target_iqn_name      = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.449383 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.storage_protocol          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.449896 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.suppress_requests_ssl_warnings = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.450393 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.target_helper             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.450889 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.target_ip_address         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.451421 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.target_port               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.451923 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.target_prefix             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.452427 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.target_protocol           = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.452923 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.trace_flags               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.453418 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.unique_fqdn_network       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.453919 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.use_chap_auth             = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.454414 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.use_multipath_for_image_xfer = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.454942 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_backend_name       = ceph {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.455469 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_clear              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.455990 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_clear_ionice       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.456475 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_clear_size         = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.456978 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.457482 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_copy_bps_limit     = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.458551 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_dd_blocksize       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.459069 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.459696 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ceph.volumes_dir               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.460320 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.460850 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.461395 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.461900 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.462430 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.462925 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.463483 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.464000 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.464521 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.465020 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.465569 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.466082 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.466634 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.467145 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.467691 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.468230 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.468734 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.470161 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.470683 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.471187 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.471726 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.472260 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.472773 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.473509 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.474482 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.475078 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl      = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.475643 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.476180 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.476692 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.477219 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.477738 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.478229 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_notifications.driver = [] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.478774 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_notifications.retry = -1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.479353 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.479739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.db.sqlalchemy.api [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Building query based on filter {{(pid=133391) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Aug 27 20:40:00.480131 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] oslo_messaging_notifications.transport_url = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.480613 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.481056 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] key_manager.fixed_key          = **** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.481646 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.482165 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.barbican_api_version  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.482682 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.barbican_endpoint     = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.483220 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.barbican_endpoint_type = public {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.483774 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.barbican_region_name  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.484277 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.cafile                = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.484776 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.certfile              = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.485285 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.collect_timing        = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.485778 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.insecure              = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.486280 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.keyfile               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.486834 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.number_of_retries     = 60 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.487380 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.retry_delay           = 1 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.487929 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.send_service_user_token = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.488562 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.split_loggers         = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.489740 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.timeout               = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.490884 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.verify_ssl            = True {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.491522 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican.verify_ssl_path       = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.492102 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.auth_section = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.492663 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.auth_type = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.493196 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.cafile   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.493724 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.certfile = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.494277 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.collect_timing = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.494824 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.insecure = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.495389 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.keyfile  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.495919 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.split_loggers = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.496454 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] barbican_service_user.timeout  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.496998 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.approle_role_id          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.497520 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.approle_secret_id        = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.498064 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.cafile                   = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.498583 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.certfile                 = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.499112 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.collect_timing           = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.499669 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.insecure                 = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.500213 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.keyfile                  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.500776 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.kv_mountpoint            = secret {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.501310 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.kv_version               = 2 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.501837 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.namespace                = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.502372 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.root_token_id            = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.502826 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=133391) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Aug 27 20:40:00.503121 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.split_loggers            = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.503686 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.ssl_ca_crt_file          = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.504227 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.timeout                  = None {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.504995 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.use_ssl                  = False {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.505983 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 27 20:40:00.506462 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] ******************************************************************************** {{(pid=133218) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Aug 27 20:40:00.515420 ncdv-master-1 cinder-volume[133391]: INFO cinder.keymgr.migration [None req-1a1e3f16-f74e-46db-8846-3933708ee8c2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 27 20:40:00.517539 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.562775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.595207 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:40:00.628519 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Driver initialization completed successfully.
Aug 27 20:40:00.629448 ncdv-master-1 cinder-volume[133391]: INFO cinder.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Initiating service 3 cleanup
Aug 27 20:40:00.639388 ncdv-master-1 cinder-volume[133391]: INFO cinder.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Service 3 cleanup completed.
Aug 27 20:40:00.639733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.service [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Creating RPC server for service cinder-volume {{(pid=133391) start /opt/stack/cinder/cinder/service.py:238}}
Aug 27 20:40:00.646981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.service [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=133391) start /opt/stack/cinder/cinder/service.py:244}}
Aug 27 20:40:00.715167 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Aug 27 20:40:00.716515 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.764792 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:40:00.831313 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1c7077d6-40ec-4c3b-83ba-5575187ab195 None None] Driver post RPC initialization completed successfully.
Aug 27 20:40:10.169995 ncdv-master-1 cinder-volume[133218]: DEBUG dbcounter [-] [133218] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=133218) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:40:10.823444 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:40:10.824953 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=20,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:40:20.846224 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:40:50.833765 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:41:00.840200 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:41:02.835659 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:41:02.836643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:41:02.863160 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:41:02.889207 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:41:20.842397 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:41:40.844830 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:42:00.845975 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:42:00.847534 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:42:02.835121 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:42:02.835877 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:42:02.860707 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:42:02.886078 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:42:20.847605 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:42:30.858500 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:42:50.859131 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:43:02.831491 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:43:02.832212 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:43:02.856054 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:43:02.881140 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:43:10.855959 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:43:30.855970 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:43:50.851913 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:44:02.828345 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:44:02.829479 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:44:02.855193 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:44:02.878286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:44:10.846254 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:44:30.839923 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:44:50.843057 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:44:50.847503 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:45:20.850188 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:45:40.845437 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:45:40.846477 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:46:02.826525 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:46:02.827693 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:46:02.864003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:46:02.890210 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:46:20.838361 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:46:20.840504 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:46:40.844983 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:46:50.856486 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:47:02.825742 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:47:02.826484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:47:02.852370 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:47:02.878587 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:47:20.852393 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:47:30.842800 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:48:00.842372 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:48:02.824683 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:48:02.825481 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:48:02.852868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:48:02.879569 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:48:10.840464 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:48:40.836482 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:48:50.833263 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:49:02.824209 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:49:02.825516 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:49:02.927800 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:49:03.056153 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:49:10.834641 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:49:30.827325 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:49:50.828826 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:50:02.825599 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:50:02.826254 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:50:02.916605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:50:02.989295 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:50:20.827709 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:50:20.829224 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:51:00.824345 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:51:00.825217 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:51:02.824547 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:51:02.825194 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:51:02.927631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:51:02.986656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:51:20.833031 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:51:40.836810 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:00.832329 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:02.823464 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:52:02.824469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:02.899321 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:02.967853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:52:20.830590 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:23.947286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:52:23.997385 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Flow 'volume_create_manager' (39653288-7354-4896-802f-dc5de4828246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:52:24.004825 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43115b05-bbb2-4471-a7a9-21e84e3b20ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.054728 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43115b05-bbb2-4471-a7a9-21e84e3b20ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1931289962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e15136f4-31eb-40f1-9622-697a3f2e4960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fc49f44f7a4bcca55eae824956691c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:52:24Z,use_quota=True,user_id='9f6ceb86c4584847aa1ec7631644a264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.059437 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef8fc74-fea3-4d1a-aca2-8178ea5be505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.063138 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ef8fc74-fea3-4d1a-aca2-8178ea5be505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.067797 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d272b-2597-4c86-9161-61662c734cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.071792 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (546d272b-2597-4c86-9161-61662c734cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e15136f4-31eb-40f1-9622-697a3f2e4960', 'volume_name': 'volume-e15136f4-31eb-40f1-9622-697a3f2e4960', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.077163 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e6c966-143a-470e-ad99-d4ca281a47b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.081867 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e6c966-143a-470e-ad99-d4ca281a47b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.090576 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24723787-0acd-497b-9ce3-429f89d81f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.092046 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Volume e15136f4-31eb-40f1-9622-697a3f2e4960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e15136f4-31eb-40f1-9622-697a3f2e4960', 'volume_size': 1}
Aug 27 20:52:24.092679 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] creating volume 'volume-e15136f4-31eb-40f1-9622-697a3f2e4960' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 20:52:24.093633 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:24.355391 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:52:24.355946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:52:24.360018 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24723787-0acd-497b-9ce3-429f89d81f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e15136f4-31eb-40f1-9622-697a3f2e4960', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.364669 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943245b4-0942-4730-87e1-9e9ab94d6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:24.389309 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Volume volume-e15136f4-31eb-40f1-9622-697a3f2e4960 (e15136f4-31eb-40f1-9622-697a3f2e4960): created successfully
Aug 27 20:52:24.393910 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943245b4-0942-4730-87e1-9e9ab94d6700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:24.407799 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Flow 'volume_create_manager' (39653288-7354-4896-802f-dc5de4828246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:52:24.433305 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e6d32130-2847-4d16-b12b-4f2f9459a6f6 tempest-VolumesAdminNegativeTest-250760484 None] Created volume successfully.
Aug 27 20:52:27.162563 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 req-6fc37cd7-7800-4f6f-8427-412781073b68 tempest-VolumesAdminNegativeTest-250760484 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:52:28.613091 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 req-6fc37cd7-7800-4f6f-8427-412781073b68 tempest-VolumesAdminNegativeTest-250760484 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.452s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:52:28.613880 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 req-6fc37cd7-7800-4f6f-8427-412781073b68 tempest-VolumesAdminNegativeTest-250760484 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e15136f4-31eb-40f1-9622-697a3f2e4960', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'e15136f4-31eb-40f1-9622-697a3f2e4960', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:52:28.723847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 req-6fc37cd7-7800-4f6f-8427-412781073b68 tempest-VolumesAdminNegativeTest-250760484 None] Connection info returned from driver {'name': 'volumes/volume-e15136f4-31eb-40f1-9622-697a3f2e4960', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e15136f4-31eb-40f1-9622-697a3f2e4960', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8399f3da-9c5a-44b6-93c5-afe05ffd0e00'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:52:28.867020 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-e3e0e9ed-bd67-42c5-b237-c943e360bd10 req-6fc37cd7-7800-4f6f-8427-412781073b68 tempest-VolumesAdminNegativeTest-250760484 None] attachment_update completed successfully.
Aug 27 20:52:35.429169 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=24,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:35.431065 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-6b8d4ba7-c998-41ef-bc16-b8458d46793a req-e9032423-234e-447d-a19e-4d50191e268a tempest-VolumesAdminNegativeTest-250760484 None] Terminate volume connection completed successfully.
Aug 27 20:52:35.431680 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-6b8d4ba7-c998-41ef-bc16-b8458d46793a req-e9032423-234e-447d-a19e-4d50191e268a tempest-VolumesAdminNegativeTest-250760484 None] Deleting attachment 8399f3da-9c5a-44b6-93c5-afe05ffd0e00. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:52:50.841017 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:53.322850 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=7,cinder:SELECT=21 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:52:53.334994 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:52:53.361130 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Flow 'volume_create_manager' (9cba2251-c115-4481-a18e-fd4d289890a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:52:53.367442 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f412c3-8c72-4fcf-b03d-4bd2d7000ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.384547 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66f412c3-8c72-4fcf-b03d-4bd2d7000ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-505647062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4790dce8-465e-48ef-bd27-8cc752e42d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96fc49f44f7a4bcca55eae824956691c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:52:53Z,use_quota=True,user_id='9f6ceb86c4584847aa1ec7631644a264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.389682 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff22a46-874f-4efa-b9d4-b582e7f502cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.393702 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff22a46-874f-4efa-b9d4-b582e7f502cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.398895 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d29447-73d5-4ef1-9838-e7ffe6752317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.402812 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4d29447-73d5-4ef1-9838-e7ffe6752317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4790dce8-465e-48ef-bd27-8cc752e42d75', 'volume_name': 'volume-4790dce8-465e-48ef-bd27-8cc752e42d75', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.407489 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b730e516-d44e-4997-ae0e-542635bbad95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.411267 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b730e516-d44e-4997-ae0e-542635bbad95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.415840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ad6094-c311-4f13-ad17-c990f8466f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.416880 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Volume 4790dce8-465e-48ef-bd27-8cc752e42d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4790dce8-465e-48ef-bd27-8cc752e42d75', 'volume_size': 1}
Aug 27 20:52:53.417278 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] creating volume 'volume-4790dce8-465e-48ef-bd27-8cc752e42d75' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 20:52:53.418084 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:53.489613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:52:53.490050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:52:53.493829 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ad6094-c311-4f13-ad17-c990f8466f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4790dce8-465e-48ef-bd27-8cc752e42d75', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.498421 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a875f-ab54-4a4c-9dfe-9a9df17b055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:52:53.509393 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Volume volume-4790dce8-465e-48ef-bd27-8cc752e42d75 (4790dce8-465e-48ef-bd27-8cc752e42d75): created successfully
Aug 27 20:52:53.514522 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c3a875f-ab54-4a4c-9dfe-9a9df17b055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:52:53.521739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Flow 'volume_create_manager' (9cba2251-c115-4481-a18e-fd4d289890a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:52:53.534644 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ff99b1ba-d31c-47ea-ad2f-e541a7213a29 tempest-VolumesAdminNegativeTest-250760484 None] Created volume successfully.
Aug 27 20:52:54.481557 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Acquiring lock "cinder-4790dce8-465e-48ef-bd27-8cc752e42d75-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:52:54.496403 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Lock "cinder-4790dce8-465e-48ef-bd27-8cc752e42d75-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:52:54.535111 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:54.608322 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:52:54.614786 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Volume volume-4790dce8-465e-48ef-bd27-8cc752e42d75 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:52:54.641671 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] deleting rbd volume volume-4790dce8-465e-48ef-bd27-8cc752e42d75 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:52:54.920268 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 20:52:54.921087 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 20:52:54.944104 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Created reservations ['079a8530-4afc-41d8-bb52-714bf1499a7a', 'dc99b0bf-0f5f-4eb2-a915-ad1cbf34af64', '69835e61-74b6-441f-80ed-247dd52549c1', 'e6e501f1-57e2-4ae5-aa90-04e989f7021c'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:52:55.007272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:55.047516 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:52:55.075810 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:52:55.080345 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Deleted volume successfully.
Aug 27 20:52:55.095669 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6347ecba-1210-4dc3-b67c-af25c0d47a43 tempest-VolumesAdminNegativeTest-250760484 None] Lock "cinder-4790dce8-465e-48ef-bd27-8cc752e42d75-delete_volume" released by "delete_volume" :: held 0.599s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:53:02.824173 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:53:02.824853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:02.903581 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:02.979779 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:53:07.743389 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Acquiring lock "cinder-e15136f4-31eb-40f1-9622-697a3f2e4960-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:53:07.812432 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Lock "cinder-e15136f4-31eb-40f1-9622-697a3f2e4960-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:53:07.950875 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:08.129170 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:53:08.130050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Volume volume-e15136f4-31eb-40f1-9622-697a3f2e4960 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:53:08.141806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] deleting rbd volume volume-e15136f4-31eb-40f1-9622-697a3f2e4960 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:53:08.742578 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Created reservations ['fc0ec515-6639-4558-9e77-dbb6c42e210d', 'f201d485-0907-4e8c-9a66-3a2edcb24657', '2a583900-2018-4f68-b640-d7decbdfd3f5', '912cd3d0-5da6-46f8-9b3a-2731d1b31835'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:53:08.841585 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:08.902067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:08.984063 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:53:08.996371 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Deleted volume successfully.
Aug 27 20:53:09.030734 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2586ed48-917a-413c-9b18-977e012e455c tempest-VolumesAdminNegativeTest-250760484 None] Lock "cinder-e15136f4-31eb-40f1-9622-697a3f2e4960-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:53:20.835539 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=37,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:53:30.834401 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:DELETE=1,cinder:SELECT=28,cinder:UPDATE=13,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:53:31.598573 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:53:31.619241 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (f67e1e59-972c-4415-b8b1-df4611e9cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:53:31.625823 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c24766-96aa-4698-bf5c-3435998e9531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.643654 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5c24766-96aa-4698-bf5c-3435998e9531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-932665117',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d1446df3-c151-4097-b737-85c00a26dec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5718b7012004d30983db126ff75e348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:53:32Z,use_quota=True,user_id='c75d7c2bf734450886113fe48be6c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.649942 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f885b72-ebea-4951-91a8-5f455beee04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.654346 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f885b72-ebea-4951-91a8-5f455beee04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.659884 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfc1504-6789-4775-8bb8-2cc815adb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.664652 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfc1504-6789-4775-8bb8-2cc815adb263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1446df3-c151-4097-b737-85c00a26dec0', 'volume_name': 'volume-d1446df3-c151-4097-b737-85c00a26dec0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.669954 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2784e95-8f92-4b21-b603-7f69facba3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.674059 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2784e95-8f92-4b21-b603-7f69facba3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.678868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a2b71-f90b-4542-b23b-556ee58f6321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.680869 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume d1446df3-c151-4097-b737-85c00a26dec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1446df3-c151-4097-b737-85c00a26dec0', 'volume_size': 1}
Aug 27 20:53:31.681268 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] creating volume 'volume-d1446df3-c151-4097-b737-85c00a26dec0' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 20:53:31.682078 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:53:31.755119 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:53:31.755545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:53:31.759723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a2b71-f90b-4542-b23b-556ee58f6321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1446df3-c151-4097-b737-85c00a26dec0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.764954 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d2a82c-902b-4766-b43a-c7a579b946fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:53:31.775176 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-d1446df3-c151-4097-b737-85c00a26dec0 (d1446df3-c151-4097-b737-85c00a26dec0): created successfully
Aug 27 20:53:31.779658 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d2a82c-902b-4766-b43a-c7a579b946fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:53:31.787256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (f67e1e59-972c-4415-b8b1-df4611e9cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:53:31.797036 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-03e2ea8f-6303-4cb4-83da-edbeee606e87 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created volume successfully.
Aug 27 20:53:33.871743 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-3120af55-2a91-4f18-bb59-63917e2d876f req-eb3cd579-c43e-4925-8145-9d20881dcee9 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:53:35.033673 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-3120af55-2a91-4f18-bb59-63917e2d876f req-eb3cd579-c43e-4925-8145-9d20881dcee9 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.162s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:53:35.035270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-3120af55-2a91-4f18-bb59-63917e2d876f req-eb3cd579-c43e-4925-8145-9d20881dcee9 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d1446df3-c151-4097-b737-85c00a26dec0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'd1446df3-c151-4097-b737-85c00a26dec0', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:53:35.068023 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-3120af55-2a91-4f18-bb59-63917e2d876f req-eb3cd579-c43e-4925-8145-9d20881dcee9 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Connection info returned from driver {'name': 'volumes/volume-d1446df3-c151-4097-b737-85c00a26dec0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd1446df3-c151-4097-b737-85c00a26dec0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '906adceb-e8a6-4465-937e-b865aa923c9f'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:53:35.135914 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-3120af55-2a91-4f18-bb59-63917e2d876f req-eb3cd579-c43e-4925-8145-9d20881dcee9 tempest-LiveAutoBlockMigrationV225Test-547847934 None] attachment_update completed successfully.
Aug 27 20:53:48.330579 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-e5a4d280-30d5-4532-b9ae-930b07405a2c tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:53:50.560609 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-e5a4d280-30d5-4532-b9ae-930b07405a2c tempest-LiveAutoBlockMigrationV225Test-1218965138 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.230s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:53:50.562439 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-e5a4d280-30d5-4532-b9ae-930b07405a2c tempest-LiveAutoBlockMigrationV225Test-1218965138 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d1446df3-c151-4097-b737-85c00a26dec0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'd1446df3-c151-4097-b737-85c00a26dec0', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:53:50.605797 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-e5a4d280-30d5-4532-b9ae-930b07405a2c tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Connection info returned from driver {'name': 'volumes/volume-d1446df3-c151-4097-b737-85c00a26dec0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd1446df3-c151-4097-b737-85c00a26dec0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '83166be3-0c64-40b6-b521-49348807c276'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:53:50.703264 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-e5a4d280-30d5-4532-b9ae-930b07405a2c tempest-LiveAutoBlockMigrationV225Test-1218965138 None] attachment_update completed successfully.
Aug 27 20:53:50.853684 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=31,cinder:UPDATE=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:54:02.822038 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:54:02.822896 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:54:02.864145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:54:02.904723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:54:10.227585 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=32,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:54:10.256715 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-9ab6b269-1858-4ca6-bafd-3cbe53f35980 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Terminate volume connection completed successfully.
Aug 27 20:54:10.256715 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-a4783271-a085-4abf-bb8b-7874c417c2a6 req-9ab6b269-1858-4ca6-bafd-3cbe53f35980 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Deleting attachment 906adceb-e8a6-4465-937e-b865aa923c9f. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:54:21.567800 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:54:21.586516 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 req-5bcfc9a8-7fd6-4f0b-924f-3d0a4af9c59d tempest-LiveAutoBlockMigrationV225Test-547847934 None] Terminate volume connection completed successfully.
Aug 27 20:54:21.586929 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-ac5a736d-a8dd-4cba-b6b4-0250437d2e92 req-5bcfc9a8-7fd6-4f0b-924f-3d0a4af9c59d tempest-LiveAutoBlockMigrationV225Test-547847934 None] Deleting attachment 83166be3-0c64-40b6-b521-49348807c276. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:54:24.069269 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:54:24.113054 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (48f2acf9-84d4-49bd-82d1-efe9000eb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:54:24.121855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f000f44-9578-47cb-80cb-a7e4cfca1ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:24.145885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f000f44-9578-47cb-80cb-a7e4cfca1ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-884176136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0e3b6613-4290-42c9-9b9f-bdced8970206,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5718b7012004d30983db126ff75e348',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:54:24Z,use_quota=True,user_id='c75d7c2bf734450886113fe48be6c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:24.153070 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb01a8d-f78c-4d47-8ce4-0aa8858b76ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:24.158013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb01a8d-f78c-4d47-8ce4-0aa8858b76ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:24.168865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71d4ee-f65c-43f4-ad5c-679236d577aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:24.327405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb71d4ee-f65c-43f4-ad5c-679236d577aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'volume_name': 'volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aca56af0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:24.332466 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d6194f-b6d4-4020-8652-89df3a5dd725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:24.339936 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d6194f-b6d4-4020-8652-89df3a5dd725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:24.345989 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a7fb33-1076-473a-84d1-4b0e98537797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:24.347704 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume 0e3b6613-4290-42c9-9b9f-bdced8970206: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aca56af0>}
Aug 27 20:54:24.348791 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Cloning 0e3b6613-4290-42c9-9b9f-bdced8970206 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 20:54:24.349861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:54:24.366467 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:54:24.379836 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Preparing cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:889}}
Aug 27 20:54:24.381130 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 20:54:29.592892 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:54:29.633379 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Flow 'volume_create_manager' (87e7267d-7b75-498e-8824-f50890553760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:54:29.641458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15507d1-1ef7-409c-a10e-8c6733387910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:29.682127 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b15507d1-1ef7-409c-a10e-8c6733387910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1372711336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4ccf977a-1a3d-47cc-9d34-799b322f16cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459a7cdda740490a900289697e84372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:54:30Z,use_quota=True,user_id='43dd6f015403486491e8140062f43bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:29.707815 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf038e-658c-4370-9dd5-4ff0ea111f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:29.724710 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf038e-658c-4370-9dd5-4ff0ea111f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:29.737975 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232e1d43-fa65-40dd-a947-73a28dbe420c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:29.776947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232e1d43-fa65-40dd-a947-73a28dbe420c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'volume_name': 'volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:29.799907 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a9bfda-d97a-413c-8b40-23151136b2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:29.812809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44a9bfda-d97a-413c-8b40-23151136b2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:29.826338 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82a1c8f-dd38-4819-ab93-09f3b516d6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:29.831064 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Volume 4ccf977a-1a3d-47cc-9d34-799b322f16cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'volume_size': 1}
Aug 27 20:54:29.831661 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] creating volume 'volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 20:54:29.833718 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:54:29.982942 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:54:29.983493 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:54:29.988557 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82a1c8f-dd38-4819-ab93-09f3b516d6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:30.009603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b152efae-740d-4f0c-a444-ad6c66e2ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:54:30.030174 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Volume volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd (4ccf977a-1a3d-47cc-9d34-799b322f16cd): created successfully
Aug 27 20:54:30.041327 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b152efae-740d-4f0c-a444-ad6c66e2ec61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:54:30.049304 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Flow 'volume_create_manager' (87e7267d-7b75-498e-8824-f50890553760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:54:30.073185 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1c342694-8026-45f5-ab82-439173b299be tempest-LiveMigrationTest-1041689321 None] Created volume successfully.
Aug 27 20:54:31.793533 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-746936f9-a280-4141-81f5-21d9406da2f0 req-857abcf5-18e4-4814-8847-5d03c22b05ac tempest-LiveMigrationTest-1041689321 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:33.461785 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-746936f9-a280-4141-81f5-21d9406da2f0 req-857abcf5-18e4-4814-8847-5d03c22b05ac tempest-LiveMigrationTest-1041689321 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.668s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:33.467157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-746936f9-a280-4141-81f5-21d9406da2f0 req-857abcf5-18e4-4814-8847-5d03c22b05ac tempest-LiveMigrationTest-1041689321 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:54:33.527681 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-746936f9-a280-4141-81f5-21d9406da2f0 req-857abcf5-18e4-4814-8847-5d03c22b05ac tempest-LiveMigrationTest-1041689321 None] Connection info returned from driver {'name': 'volumes/volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '74b448a7-3210-4b70-9f1b-9a2c441b5b08'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:54:33.645142 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-746936f9-a280-4141-81f5-21d9406da2f0 req-857abcf5-18e4-4814-8847-5d03c22b05ac tempest-LiveMigrationTest-1041689321 None] attachment_update completed successfully.
Aug 27 20:54:43.811226 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-632f300a-033f-4666-b3c2-6c054d152a98 req-92777ff7-0298-42d4-98d2-8f28069691a3 tempest-LiveMigrationTest-613315971 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:45.872545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph, size 616.00 MB, duration 21.48 sec {{(pid=133391) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Aug 27 20:54:45.874869 ncdv-master-1 cinder-volume[133391]: INFO cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Image download 616.00 MB at 28.67 MB/s
Aug 27 20:54:45.950172 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:46.002082 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-632f300a-033f-4666-b3c2-6c054d152a98 req-92777ff7-0298-42d4-98d2-8f28069691a3 tempest-LiveMigrationTest-613315971 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.190s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:46.002944 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-632f300a-033f-4666-b3c2-6c054d152a98 req-92777ff7-0298-42d4-98d2-8f28069691a3 tempest-LiveMigrationTest-613315971 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:54:46.058377 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-632f300a-033f-4666-b3c2-6c054d152a98 req-92777ff7-0298-42d4-98d2-8f28069691a3 tempest-LiveMigrationTest-613315971 None] Connection info returned from driver {'name': 'volumes/volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4ccf977a-1a3d-47cc-9d34-799b322f16cd', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c110026c-fc03-472b-8cea-76b3c32ad5db'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:54:46.205207 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-632f300a-033f-4666-b3c2-6c054d152a98 req-92777ff7-0298-42d4-98d2-8f28069691a3 tempest-LiveMigrationTest-613315971 None] attachment_update completed successfully.
Aug 27 20:54:46.228147 ncdv-master-1 sudo[146618]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph
Aug 27 20:54:46.229113 ncdv-master-1 sudo[146618]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:54:48.777461 ncdv-master-1 sudo[146618]: pam_unix(sudo:session): session closed for user root
Aug 27 20:54:48.785819 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph" returned: 0 in 2.832s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:48.790650 ncdv-master-1 cinder-volume[133391]: WARNING py.warnings [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Aug 27 20:54:48.790650 ncdv-master-1 cinder-volume[133391]:   debtcollector.deprecate(
Aug 27 20:54:48.790650 ncdv-master-1 cinder-volume[133391]: 
Aug 27 20:54:48.791806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Temporary image 3c9ca970-c391-4d4a-9934-78cc80446a1e is fetched for user c75d7c2bf734450886113fe48be6c44e. {{(pid=133391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Aug 27 20:54:48.919208 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:49.118658 ncdv-master-1 sudo[146733]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph
Aug 27 20:54:49.119569 ncdv-master-1 sudo[146733]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:54:50.843972 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=41,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:54:51.368581 ncdv-master-1 sudo[146733]: pam_unix(sudo:session): session closed for user root
Aug 27 20:54:51.372225 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph" returned: 0 in 2.452s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:51.373829 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] creating volume 'volume-0e3b6613-4290-42c9-9b9f-bdced8970206' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 20:54:51.375228 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:54:51.525745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:54:51.526126 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:54:51.554014 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Attempting download of 3c9ca970-c391-4d4a-9934-78cc80446a1e ((None, None)) to volume 0e3b6613-4290-42c9-9b9f-bdced8970206. {{(pid=133391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Aug 27 20:54:51.618849 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3c9ca970-c391-4d4a-9934-78cc80446a1e_zhmbr3cr {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:51.798550 ncdv-master-1 sudo[146868]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3c9ca970-c391-4d4a-9934-78cc80446a1e_zhmbr3cr
Aug 27 20:54:51.799412 ncdv-master-1 sudo[146868]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:54:53.369691 ncdv-master-1 sudo[146868]: pam_unix(sudo:session): session closed for user root
Aug 27 20:54:53.371941 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_3c9ca970-c391-4d4a-9934-78cc80446a1e_zhmbr3cr" returned: 0 in 1.755s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:53.374000 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:53.480522 ncdv-master-1 sudo[146877]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph
Aug 27 20:54:53.481933 ncdv-master-1 sudo[146877]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:54:55.691131 ncdv-master-1 sudo[146877]: pam_unix(sudo:session): session closed for user root
Aug 27 20:54:55.694904 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph" returned: 0 in 2.320s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:55.696668 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] 3c9ca970-c391-4d4a-9934-78cc80446a1e was vhdx, converting to raw {{(pid=133391) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Aug 27 20:54:55.698200 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpmbpy7qk0 {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:55.739620 ncdv-master-1 sudo[146935]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpmbpy7qk0
Aug 27 20:54:55.741999 ncdv-master-1 sudo[146935]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:54:58.638978 ncdv-master-1 sudo[146935]: pam_unix(sudo:session): session closed for user root
Aug 27 20:54:58.641295 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpmbpy7qk0" returned: 0 in 2.943s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:54:58.643332 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:54:58.853368 ncdv-master-1 sudo[146991]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph
Aug 27 20:54:58.854309 ncdv-master-1 sudo[146991]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 27 20:55:00.363526 ncdv-master-1 sudo[146991]: pam_unix(sudo:session): session closed for user root
Aug 27 20:55:00.366386 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph" returned: 0 in 1.722s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:55:00.367140 ncdv-master-1 cinder-volume[133391]: WARNING py.warnings [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Aug 27 20:55:00.367140 ncdv-master-1 cinder-volume[133391]:   debtcollector.deprecate(
Aug 27 20:55:00.367140 ncdv-master-1 cinder-volume[133391]: 
Aug 27 20:55:00.367774 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3c9ca970-c391-4d4a-9934-78cc80446a1e_s3gi8wpfncdv-master-1@ceph, size 700.00 MB, duration 2.95 sec, destination /opt/stack/data/cinder/conversion/tmpmbpy7qk0 {{(pid=133391) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Aug 27 20:55:00.368136 ncdv-master-1 cinder-volume[133391]: INFO cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Converted 700.00 MB image at 237.69 MB/s
Aug 27 20:55:00.369590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:00.441012 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:55:00.441613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:55:00.451944 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] deleting rbd volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:55:00.829391 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpmbpy7qk0 volume-0e3b6613-4290-42c9-9b9f-bdced8970206 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:55:00.905440 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=40,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:55:00.964602 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-632f300a-033f-4666-b3c2-6c054d152a98 req-58a1321a-ab81-4979-b552-9f00ab716356 tempest-LiveMigrationTest-613315971 None] Terminate volume connection completed successfully.
Aug 27 20:55:00.965114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-632f300a-033f-4666-b3c2-6c054d152a98 req-58a1321a-ab81-4979-b552-9f00ab716356 tempest-LiveMigrationTest-613315971 None] Deleting attachment 74b448a7-3210-4b70-9f1b-9a2c441b5b08. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:55:02.835727 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:55:02.838654 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:02.947517 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:03.017688 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:55:06.773155 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpmbpy7qk0 volume-0e3b6613-4290-42c9-9b9f-bdced8970206 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 5.944s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:55:06.918036 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:07.085865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:55:07.086672 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:55:07.087216 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Downloaded image 3c9ca970-c391-4d4a-9934-78cc80446a1e ((None, None)) to volume 0e3b6613-4290-42c9-9b9f-bdced8970206 successfully. {{(pid=133391) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Aug 27 20:55:07.172077 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Temporary image 3c9ca970-c391-4d4a-9934-78cc80446a1e for user c75d7c2bf734450886113fe48be6c44e is deleted. {{(pid=133391) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Aug 27 20:55:07.429371 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created reservations ['cfb821f2-3524-465e-a15c-c1c489fececf', '63cf6a22-1b17-4b51-a176-cc911c0da889', 'd9ea988b-da66-41b9-b0cd-f9b0f81045e5', '93152256-a5ef-4024-b4d0-51784dd78913'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:55:07.447716 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Creating image volume entry: {'display_description': None, 'consistencygroup_id': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'scheduled_at': datetime.datetime(2022, 8, 27, 20, 54, 24, tzinfo=datetime.timezone.utc), 'ec2_id': None, 'group_id': None, 'provider_auth': None, 'previous_status': None, 'size': 1, 'volume_admin_metadata': [], 'replication_status': None, 'multiattach': False, 'metadata': {}, 'shared_targets': True, 'provider_location': None, 'provider_geometry': None, 'display_name': 'image-3c9ca970-c391-4d4a-9934-78cc80446a1e', 'replication_extended_status': None, 'project_id': '6988df1452994470ae9cc2548d45e0d7', 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'deleted': False, 'bootable': False, 'availability_zone': 'nova', 'replication_driver_data': None, 'volume_metadata': [], 'encryption_key_id': None, 'cluster_name': None, 'terminated_at': None, 'updated_at': datetime.datetime(2022, 8, 27, 20, 54, 24, tzinfo=datetime.timezone.utc), 'service_uuid': None, 'host': 'ncdv-master-1@ceph#ceph', 'user_id': 'c75d7c2bf734450886113fe48be6c44e', 'provider_id': None, 'deleted_at': None, 'created_at': datetime.datetime(2022, 8, 27, 20, 54, 24, tzinfo=datetime.timezone.utc), 'launched_at': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '0e3b6613-4290-42c9-9b9f-bdced8970206'}. {{(pid=133391) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}}
Aug 27 20:55:07.532222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume reschedule parameters: False retry: None {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:55:07.560387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (5653c383-b804-47f2-9e5b-681c6de4b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:55:07.568158 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2018c8b-0aa5-40ba-a7c5-7ea5db7d3617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:07.598490 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2018c8b-0aa5-40ba-a7c5-7ea5db7d3617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='image-3c9ca970-c391-4d4a-9934-78cc80446a1e',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b64ec5dc-2485-4680-b8d2-3e011c15d8ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6988df1452994470ae9cc2548d45e0d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=0e3b6613-4290-42c9-9b9f-bdced8970206,status='creating',terminated_at=None,updated_at=2022-08-27T20:54:24Z,use_quota=True,user_id='c75d7c2bf734450886113fe48be6c44e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:07.605807 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f258e9e-aada-47c5-b061-25737188a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:07.610468 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f258e9e-aada-47c5-b061-25737188a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:07.615853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2944fb5-6a65-451b-b52e-9d04c1904a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:07.636622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2944fb5-6a65-451b-b52e-9d04c1904a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'volume_name': 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'volume_size': 1, 'source_volid': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'source_volstatus': 'downloading'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:07.641488 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49df1b3-411f-4aed-8602-e86efe5c8e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:07.646287 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49df1b3-411f-4aed-8602-e86efe5c8e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:07.652157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e98ee0e-8ff9-4c11-9fe1-78055073e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:07.652991 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'volume_size': 1, 'source_volid': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'source_volstatus': 'downloading'}
Aug 27 20:55:07.667886 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:07.727781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] creating snapshot='volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 20:55:08.619016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] cloning 'volume-0e3b6613-4290-42c9-9b9f-bdced8970206@volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee.clone_snap' to 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 20:55:08.789495 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:55:08.791101 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:55:08.791641 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:55:08.844081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 20:55:08.847961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e98ee0e-8ff9-4c11-9fe1-78055073e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'volume_size': 1, 'source_volid': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'source_volstatus': 'downloading'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:08.859068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a368121b-69b2-4e2e-a91a-c9c94a3c9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:08.877042 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee (b64ec5dc-2485-4680-b8d2-3e011c15d8ee): created successfully
Aug 27 20:55:08.895602 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a368121b-69b2-4e2e-a91a-c9c94a3c9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:08.904956 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (5653c383-b804-47f2-9e5b-681c6de4b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:55:08.919101 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created volume successfully.
Aug 27 20:55:08.979003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Creating new image-volume cache entry for image 3c9ca970-c391-4d4a-9934-78cc80446a1e on ncdv-master-1@ceph#ceph {{(pid=133391) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Aug 27 20:55:08.999865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] New image-volume cache entry created: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 20, 55, 8, 983759)}. {{(pid=133391) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Aug 27 20:55:09.008930 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 44.642s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:55:09.009465 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Marking volume 0e3b6613-4290-42c9-9b9f-bdced8970206 as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 20:55:09.025529 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to 0e3b6613-4290-42c9-9b9f-bdced8970206. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 20:55:09.025995 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Creating volume glance metadata for volume 0e3b6613-4290-42c9-9b9f-bdced8970206 backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 20:55:09.153445 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a7fb33-1076-473a-84d1-4b0e98537797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aca56af0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:09.160772 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03e8138-ada4-43eb-a641-a0b24c98b652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:09.175778 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 (0e3b6613-4290-42c9-9b9f-bdced8970206): created successfully
Aug 27 20:55:09.180871 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03e8138-ada4-43eb-a641-a0b24c98b652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:09.187688 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Flow 'volume_create_manager' (48f2acf9-84d4-49bd-82d1-efe9000eb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:55:09.198271 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-16df4242-30d5-4247-9167-044e5ac9d0b7 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created volume successfully.
Aug 27 20:55:14.401311 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 req-588971a2-5785-4225-9377-f1d34806051e tempest-LiveMigrationTest-1041689321 None] Terminate volume connection completed successfully.
Aug 27 20:55:14.401894 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1646bf70-1db4-4dac-abc9-8d5e4e0479e4 req-588971a2-5785-4225-9377-f1d34806051e tempest-LiveMigrationTest-1041689321 None] Deleting attachment c110026c-fc03-472b-8cea-76b3c32ad5db. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:55:15.302331 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-26d151df-d92d-48bf-abfb-1450eddad568 req-e47fe114-5eaf-4e2f-9ab9-90091b83338a tempest-LiveAutoBlockMigrationV225Test-547847934 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:55:16.579120 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-26d151df-d92d-48bf-abfb-1450eddad568 req-e47fe114-5eaf-4e2f-9ab9-90091b83338a tempest-LiveAutoBlockMigrationV225Test-547847934 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.277s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:55:16.580663 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-26d151df-d92d-48bf-abfb-1450eddad568 req-e47fe114-5eaf-4e2f-9ab9-90091b83338a tempest-LiveAutoBlockMigrationV225Test-547847934 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:55:16.650973 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-26d151df-d92d-48bf-abfb-1450eddad568 req-e47fe114-5eaf-4e2f-9ab9-90091b83338a tempest-LiveAutoBlockMigrationV225Test-547847934 None] Connection info returned from driver {'name': 'volumes/volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aa229060-ec3b-448f-b301-4fdf4bccfb93'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:55:16.764206 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-26d151df-d92d-48bf-abfb-1450eddad568 req-e47fe114-5eaf-4e2f-9ab9-90091b83338a tempest-LiveAutoBlockMigrationV225Test-547847934 None] attachment_update completed successfully.
Aug 27 20:55:16.768354 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 20:55:16.798844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Flow 'volume_create_manager' (749217d8-4392-45f8-b4d2-76a13f2116dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:55:16.807206 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7492092c-9917-420b-8253-43f914344c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:16.828857 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7492092c-9917-420b-8253-43f914344c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T20:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-166542991',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=064bf286-106b-4a7f-a92d-c80ecd263b78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459a7cdda740490a900289697e84372b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T20:55:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T20:55:17Z,use_quota=True,user_id='43dd6f015403486491e8140062f43bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:16.851183 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f2478d-f912-42ab-87ee-5d1996a46915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:16.869349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f2478d-f912-42ab-87ee-5d1996a46915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:16.887439 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca774ca9-e33a-40be-9f90-6a2681dd8d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:17.119882 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca774ca9-e33a-40be-9f90-6a2681dd8d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '064bf286-106b-4a7f-a92d-c80ecd263b78', 'volume_name': 'volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac637f10>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:17.138650 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ce13b3-c5f4-4563-bbaa-8f4d1dcb32d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:17.152554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0ce13b3-c5f4-4563-bbaa-8f4d1dcb32d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:17.177658 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e1f93-4019-45e3-aa73-cf93a7e86b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:17.183127 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Volume 064bf286-106b-4a7f-a92d-c80ecd263b78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac637f10>}
Aug 27 20:55:17.183874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Cloning 064bf286-106b-4a7f-a92d-c80ecd263b78 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 20:55:17.184722 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:55:17.221534 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.037s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:55:17.252591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 20, 55, 17, 232183)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 20:55:17.253073 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 20:55:17.253531 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 20:55:17.269836 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.048s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:55:17.270716 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 20:55:17.284332 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 20, 55, 17, 280587)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 20:55:17.284761 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 20:55:17.285157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 20:55:17.320358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:55:17.440026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] creating snapshot='volume-064bf286-106b-4a7f-a92d-c80ecd263b78.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 20:55:18.145079 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-064bf286-106b-4a7f-a92d-c80ecd263b78.clone_snap' to 'volume-064bf286-106b-4a7f-a92d-c80ecd263b78' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 20:55:18.444180 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:55:18.449077 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 20:55:18.450450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 20:55:18.485099 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 20:55:18.487176 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Marking volume 064bf286-106b-4a7f-a92d-c80ecd263b78 as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 20:55:18.514515 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to 064bf286-106b-4a7f-a92d-c80ecd263b78. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 20:55:18.515012 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Creating volume glance metadata for volume 064bf286-106b-4a7f-a92d-c80ecd263b78 backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 20:55:18.547930 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=71,cinder:UPDATE=17,cinder:INSERT=11,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:55:18.747814 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c20e1f93-4019-45e3-aa73-cf93a7e86b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac637f10>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:18.752403 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df049967-1775-468d-9b69-7f0f528975e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 20:55:18.792854 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Volume volume-064bf286-106b-4a7f-a92d-c80ecd263b78 (064bf286-106b-4a7f-a92d-c80ecd263b78): created successfully
Aug 27 20:55:18.801619 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df049967-1775-468d-9b69-7f0f528975e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 20:55:18.829598 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Flow 'volume_create_manager' (749217d8-4392-45f8-b4d2-76a13f2116dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 20:55:18.858489 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-17379492-e10e-42c7-b34e-234c63f90ace tempest-LiveMigrationTest-1041689321 None] Created volume successfully.
Aug 27 20:55:29.731062 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-78eb08a0-be8a-4ed5-9e58-c90005200902 req-3f4b2fd6-ccce-4df6-a47c-1ed16dc51c2f tempest-LiveMigrationTest-1041689321 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:55:31.617498 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-78eb08a0-be8a-4ed5-9e58-c90005200902 req-3f4b2fd6-ccce-4df6-a47c-1ed16dc51c2f tempest-LiveMigrationTest-1041689321 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.886s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:55:31.618178 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-78eb08a0-be8a-4ed5-9e58-c90005200902 req-3f4b2fd6-ccce-4df6-a47c-1ed16dc51c2f tempest-LiveMigrationTest-1041689321 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '064bf286-106b-4a7f-a92d-c80ecd263b78', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:55:31.627596 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=64,cinder:INSERT=20,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:55:31.676393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-78eb08a0-be8a-4ed5-9e58-c90005200902 req-3f4b2fd6-ccce-4df6-a47c-1ed16dc51c2f tempest-LiveMigrationTest-1041689321 None] Connection info returned from driver {'name': 'volumes/volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '064bf286-106b-4a7f-a92d-c80ecd263b78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bd1d82d8-c9e3-478c-900b-e5c3d2214dc2'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:55:31.753232 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-78eb08a0-be8a-4ed5-9e58-c90005200902 req-3f4b2fd6-ccce-4df6-a47c-1ed16dc51c2f tempest-LiveMigrationTest-1041689321 None] attachment_update completed successfully.
Aug 27 20:55:50.902186 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:INSERT=5,cinder:SELECT=24,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:55:54.392787 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-1bcd64bb-933e-4855-bfce-f57c9c3f9d91 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:55:55.899311 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-1bcd64bb-933e-4855-bfce-f57c9c3f9d91 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.506s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:55:55.900230 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-1bcd64bb-933e-4855-bfce-f57c9c3f9d91 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:55:55.933029 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-1bcd64bb-933e-4855-bfce-f57c9c3f9d91 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Connection info returned from driver {'name': 'volumes/volume-0e3b6613-4290-42c9-9b9f-bdced8970206', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0e3b6613-4290-42c9-9b9f-bdced8970206', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed05aaf6-51af-41fc-b46b-560c41b975fb'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:55:56.014213 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-1bcd64bb-933e-4855-bfce-f57c9c3f9d91 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] attachment_update completed successfully.
Aug 27 20:56:02.839061 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:56:02.840583 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:02.915991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:02.975383 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:56:10.910434 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=24,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:56:10.912062 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:56:12.030793 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-3e18a99d-a4aa-484a-bb7d-72c2baadc910 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Terminate volume connection completed successfully.
Aug 27 20:56:12.032083 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-93cb4d99-3931-4012-84be-bb0a09cd2777 req-3e18a99d-a4aa-484a-bb7d-72c2baadc910 tempest-LiveAutoBlockMigrationV225Test-1218965138 None] Deleting attachment aa229060-ec3b-448f-b301-4fdf4bccfb93. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:56:12.842995 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-969b50a9-d385-44e0-b5d1-c40a9c9726c9 tempest-LiveMigrationTest-613315971 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 20:56:14.597212 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-969b50a9-d385-44e0-b5d1-c40a9c9726c9 tempest-LiveMigrationTest-613315971 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.757s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 20:56:14.602309 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-969b50a9-d385-44e0-b5d1-c40a9c9726c9 tempest-LiveMigrationTest-613315971 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '064bf286-106b-4a7f-a92d-c80ecd263b78', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 20:56:14.641670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-969b50a9-d385-44e0-b5d1-c40a9c9726c9 tempest-LiveMigrationTest-613315971 None] Connection info returned from driver {'name': 'volumes/volume-064bf286-106b-4a7f-a92d-c80ecd263b78', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '064bf286-106b-4a7f-a92d-c80ecd263b78', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'cbb21f1a-0c33-448e-9f6d-17e0aa3724b0'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 20:56:14.765340 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-969b50a9-d385-44e0-b5d1-c40a9c9726c9 tempest-LiveMigrationTest-613315971 None] attachment_update completed successfully.
Aug 27 20:56:22.024528 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-b1b709c5-c41f-4925-ab99-d13e8ee9153f tempest-LiveAutoBlockMigrationV225Test-547847934 None] Terminate volume connection completed successfully.
Aug 27 20:56:22.025182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-b1b709c5-c41f-4925-ab99-d13e8ee9153f tempest-LiveAutoBlockMigrationV225Test-547847934 None] Deleting attachment ed05aaf6-51af-41fc-b46b-560c41b975fb. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:56:22.334428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Acquiring lock "cinder-0e3b6613-4290-42c9-9b9f-bdced8970206-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:56:22.348972 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-0e3b6613-4290-42c9-9b9f-bdced8970206-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:56:22.419163 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:22.552907 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:56:22.553602 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] volume has clone snapshot(s) {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}}
Aug 27 20:56:22.554929 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:56:22.746639 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created reservations ['7fd0e11e-00bf-4989-b130-e8518d6ea303', '1f4c14ba-e269-4701-9673-889b3635c84f', '4b9e3085-3f00-4290-9a4f-b3ce17097449', '8e189a35-fe9b-4206-9735-ec26f94f2be2'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:56:22.867806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:22.911182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:22.976191 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:56:22.987050 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Deleted volume successfully.
Aug 27 20:56:23.010608 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-e88deecf-3f02-4d27-a5bb-eed6b80096a2 req-ba67fab3-64dd-40ce-bffb-4eb1671475e3 tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-0e3b6613-4290-42c9-9b9f-bdced8970206-delete_volume" released by "delete_volume" :: held 0.662s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:56:26.811764 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Acquiring lock "cinder-d1446df3-c151-4097-b737-85c00a26dec0-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:56:26.830100 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-d1446df3-c151-4097-b737-85c00a26dec0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:56:26.878530 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:26.987969 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:56:26.991921 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Volume volume-d1446df3-c151-4097-b737-85c00a26dec0 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:56:27.011517 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] deleting rbd volume volume-d1446df3-c151-4097-b737-85c00a26dec0 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:56:27.499802 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Created reservations ['f63a9453-5c5a-4461-a526-b16d49c6df68', 'fbd0bfff-beb8-4c7d-8df3-aa11001c9169', '9676ceb4-cb35-4956-882b-ac4ed8fb05a6', '1e4924a5-cbc8-4e54-9550-ba4f088882a0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:56:27.562204 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:27.600249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:27.635573 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:56:27.650503 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Deleted volume successfully.
Aug 27 20:56:27.668022 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6fa97f4-d6f1-4d7a-9627-544f217fb77c tempest-LiveAutoBlockMigrationV225Test-547847934 None] Lock "cinder-d1446df3-c151-4097-b737-85c00a26dec0-delete_volume" released by "delete_volume" :: held 0.838s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:56:31.125416 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-47614b31-f188-44d5-9fae-9192d0cc3520 tempest-LiveMigrationTest-613315971 None] Terminate volume connection completed successfully.
Aug 27 20:56:31.125946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-c31c4c67-8692-45ba-b33a-12a1e44a415c req-47614b31-f188-44d5-9fae-9192d0cc3520 tempest-LiveMigrationTest-613315971 None] Deleting attachment bd1d82d8-c9e3-478c-900b-e5c3d2214dc2. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:56:43.797649 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=41,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:56:43.801251 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=56,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:56:43.819670 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-6af19c98-1118-4d65-85ad-ceee7a34a58e tempest-LiveMigrationTest-1041689321 None] Terminate volume connection completed successfully.
Aug 27 20:56:43.820233 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-6af19c98-1118-4d65-85ad-ceee7a34a58e tempest-LiveMigrationTest-1041689321 None] Deleting attachment cbb21f1a-0c33-448e-9f6d-17e0aa3724b0. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 20:56:44.034363 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Acquiring lock "cinder-064bf286-106b-4a7f-a92d-c80ecd263b78-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:56:44.065157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Lock "cinder-064bf286-106b-4a7f-a92d-c80ecd263b78-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:56:44.199315 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:44.352570 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:56:44.363802 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] deleting rbd volume volume-064bf286-106b-4a7f-a92d-c80ecd263b78 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:56:44.694180 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 20:56:44.730545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] deleting parent snapshot volume-064bf286-106b-4a7f-a92d-c80ecd263b78.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 20:56:45.820792 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Acquiring lock "cinder-4ccf977a-1a3d-47cc-9d34-799b322f16cd-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 20:56:45.849513 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Lock "cinder-4ccf977a-1a3d-47cc-9d34-799b322f16cd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 20:56:45.911052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Created reservations ['b1f4f2e8-a368-4123-ba6f-9376c4a0b348', 'dad96232-6b98-4d8a-a27b-34b4ad1e8fdd', 'af947596-de3d-4479-9017-6a28b5632b1a', '3aa403f4-cf53-4f2c-abfc-328612aa24e3'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:56:45.914916 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:45.988248 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 20:56:45.988963 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Volume volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 20:56:46.006112 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] deleting rbd volume volume-4ccf977a-1a3d-47cc-9d34-799b322f16cd {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 20:56:46.128490 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:46.222418 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:46.307807 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:56:46.311904 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Deleted volume successfully.
Aug 27 20:56:46.344119 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-7cce07ec-0a3d-4416-a261-22f2829a1bfe req-22629943-9493-4681-a812-bcbf098a8bb8 tempest-LiveMigrationTest-1041689321 None] Lock "cinder-064bf286-106b-4a7f-a92d-c80ecd263b78-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:56:46.533494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Created reservations ['14eff14c-06e9-4091-9b8e-48802b73d92f', 'd29cf009-f58b-4ca8-81c7-db45270af7c6', '6d4286e8-a94b-4a8a-8c20-19cdeb20ca0c', 'ac1e2c71-e9d9-4caf-83d1-ba3dc3bc3c8c'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 20:56:46.616103 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:46.692295 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:56:46.743683 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:56:46.747876 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Deleted volume successfully.
Aug 27 20:56:46.780905 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cdb4f7df-661f-4824-97b9-f603ef6f2024 tempest-LiveMigrationTest-1041689321 None] Lock "cinder-4ccf977a-1a3d-47cc-9d34-799b322f16cd-delete_volume" released by "delete_volume" :: held 0.931s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 20:57:00.925053 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:57:02.840147 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:57:02.841469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:57:02.905185 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:57:02.982067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:57:20.945972 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=28,cinder:INSERT=5,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:57:40.948556 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:58:00.947891 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:58:02.841090 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:58:02.842734 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:58:02.918168 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:58:02.990342 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:58:20.952564 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:58:40.948426 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:58:40.959268 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:59:02.846329 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 20:59:02.847874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:59:02.950091 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 20:59:03.008965 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 20:59:20.966937 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 20:59:40.969726 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:00:00.972255 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:00:02.846363 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:00:02.847599 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:00:02.959233 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:00:03.056628 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:00:10.974874 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:00:30.977517 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:00:48.409653 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:00:48.448056 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:00:48.473845 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Flow 'volume_create_manager' (86beb55e-fcb1-4f50-9b46-cf9bba3e840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:00:48.480361 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f1bf20-a476-4672-8a16-9a3b8c533952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:48.498051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f1bf20-a476-4672-8a16-9a3b8c533952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-680186332',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7599dfd7db2647bf8f986bffd781b87d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:00:48Z,use_quota=True,user_id='9d18c23a6da54d88b00e6f7855ea82c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:48.504735 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf65ec-e38d-45a9-b908-7e5872d4536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:48.508978 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcf65ec-e38d-45a9-b908-7e5872d4536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:48.514541 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea50273-29ac-499a-9644-a3ab476f8971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:48.652422 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea50273-29ac-499a-9644-a3ab476f8971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'volume_name': 'volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac65a9d0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:48.659167 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2377c2b-c4ec-4ba6-9995-dc5d3688ad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:48.666754 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2377c2b-c4ec-4ba6-9995-dc5d3688ad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:48.684429 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b2fa32-03fd-4c7f-a242-147f345c292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:48.685837 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Volume 8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac65a9d0>}
Aug 27 21:00:48.686637 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Cloning 8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:00:48.693437 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:00:48.705702 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:00:48.721392 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 0, 48, 710435)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:00:48.722033 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:00:48.722473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:00:48.730377 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:00:48.732145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:00:48.745548 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 0, 48, 740543)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:00:48.747990 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:00:48.748455 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:00:48.775605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:00:48.865760 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] creating snapshot='volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:00:49.519142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee.clone_snap' to 'volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:00:49.714545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:00:49.717067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:00:49.717600 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:00:49.751557 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:00:49.752345 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Marking volume 8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:00:49.762062 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to 8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:00:49.763168 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Creating volume glance metadata for volume 8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:00:49.859349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75b2fa32-03fd-4c7f-a242-147f345c292f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac65a9d0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:49.881583 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaf77c7-dd36-499b-a3d0-20a26858b9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:00:49.905476 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Volume volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee (8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee): created successfully
Aug 27 21:00:49.910986 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eaf77c7-dd36-499b-a3d0-20a26858b9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:00:49.919114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Flow 'volume_create_manager' (86beb55e-fcb1-4f50-9b46-cf9bba3e840b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:00:49.941922 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-18cd6bf7-3938-4ba5-9e73-b46570468f48 tempest-ServersTestBootFromVolume-854824990 None] Created volume successfully.
Aug 27 21:00:54.715826 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-a82b3d4c-63ca-4123-a9df-7979761c3d2c req-cc32532c-f57a-48a5-a89d-fafa6d7ce12d tempest-ServersTestBootFromVolume-854824990 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:00:56.701690 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-a82b3d4c-63ca-4123-a9df-7979761c3d2c req-cc32532c-f57a-48a5-a89d-fafa6d7ce12d tempest-ServersTestBootFromVolume-854824990 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.985s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:00:56.702885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-a82b3d4c-63ca-4123-a9df-7979761c3d2c req-cc32532c-f57a-48a5-a89d-fafa6d7ce12d tempest-ServersTestBootFromVolume-854824990 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:00:56.775643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-a82b3d4c-63ca-4123-a9df-7979761c3d2c req-cc32532c-f57a-48a5-a89d-fafa6d7ce12d tempest-ServersTestBootFromVolume-854824990 None] Connection info returned from driver {'name': 'volumes/volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3915c083-7e1d-417a-a7ee-cfd07759cc3d'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:00:56.913429 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-a82b3d4c-63ca-4123-a9df-7979761c3d2c req-cc32532c-f57a-48a5-a89d-fafa6d7ce12d tempest-ServersTestBootFromVolume-854824990 None] attachment_update completed successfully.
Aug 27 21:01:02.852279 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:01:02.855726 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:02.920960 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:03.018196 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:01:06.910266 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=25,cinder:UPDATE=5,cinder:INSERT=3,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:01:10.981248 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=32,cinder:UPDATE=7,cinder:INSERT=9 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:01:11.591823 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:01:11.645532 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Flow 'volume_create_manager' (c595440b-f2f9-4094-ace7-9effdee6cdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:01:11.666039 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afc8ab0-9e6e-4409-b1c4-01258d73521b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.690914 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6afc8ab0-9e6e-4409-b1c4-01258d73521b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-462320281',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=313d6b93-94c9-4348-90d5-a3f2155ac7f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='296e209e3b624bb9a75b2c8fad0b8b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:01:12Z,use_quota=True,user_id='69894e287f1d457dacc403bf68c314af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.699946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac86396-c32b-4164-b1f1-fe46449ba7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.706024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac86396-c32b-4164-b1f1-fe46449ba7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.713004 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fcb9ef-c374-4a58-8e36-4c03d1429316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.718945 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0fcb9ef-c374-4a58-8e36-4c03d1429316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'volume_name': 'volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.729839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee19f42-a86c-45e3-a834-0d7527dc11dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.737037 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee19f42-a86c-45e3-a834-0d7527dc11dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.744596 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36942ae3-f286-440c-b2be-747d07629419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.746468 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Volume 313d6b93-94c9-4348-90d5-a3f2155ac7f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'volume_size': 1}
Aug 27 21:01:11.747132 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] creating volume 'volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:01:11.748586 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:11.919962 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:01:11.922009 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:01:11.934494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36942ae3-f286-440c-b2be-747d07629419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.958611 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232ac8a-0945-4699-8613-01c2f6dc787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:01:11.976360 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Volume volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0 (313d6b93-94c9-4348-90d5-a3f2155ac7f0): created successfully
Aug 27 21:01:11.983711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2232ac8a-0945-4699-8613-01c2f6dc787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:01:11.989260 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Flow 'volume_create_manager' (c595440b-f2f9-4094-ace7-9effdee6cdd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:01:12.002844 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b89ebf80-4964-4dcc-8702-365bb16692b9 tempest-AttachSCSIVolumeTestJSON-349361316 None] Created volume successfully.
Aug 27 21:01:13.690417 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 req-5e46c7bf-6ac7-4c54-ba8f-6aa203bd8450 tempest-AttachSCSIVolumeTestJSON-349361316 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:01:15.427870 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 req-5e46c7bf-6ac7-4c54-ba8f-6aa203bd8450 tempest-AttachSCSIVolumeTestJSON-349361316 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.737s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:01:15.429498 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 req-5e46c7bf-6ac7-4c54-ba8f-6aa203bd8450 tempest-AttachSCSIVolumeTestJSON-349361316 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:01:15.462376 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 req-5e46c7bf-6ac7-4c54-ba8f-6aa203bd8450 tempest-AttachSCSIVolumeTestJSON-349361316 None] Connection info returned from driver {'name': 'volumes/volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '313d6b93-94c9-4348-90d5-a3f2155ac7f0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a5c988c7-a500-4495-876d-d385ae7d913c'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:01:15.556650 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-9b2b6547-3a51-44d8-af9f-952173c7f7b6 req-5e46c7bf-6ac7-4c54-ba8f-6aa203bd8450 tempest-AttachSCSIVolumeTestJSON-349361316 None] attachment_update completed successfully.
Aug 27 21:01:19.506107 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c req-864d2cdd-83db-4122-8afa-87bb32e5aa48 tempest-AttachSCSIVolumeTestJSON-349361316 None] Terminate volume connection completed successfully.
Aug 27 21:01:19.512300 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-c998e6c6-dd39-4e10-a2d5-667a6abc7a0c req-864d2cdd-83db-4122-8afa-87bb32e5aa48 tempest-AttachSCSIVolumeTestJSON-349361316 None] Deleting attachment a5c988c7-a500-4495-876d-d385ae7d913c. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:01:30.992471 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=21,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:01:37.529551 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Acquiring lock "cinder-313d6b93-94c9-4348-90d5-a3f2155ac7f0-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:01:37.548811 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Lock "cinder-313d6b93-94c9-4348-90d5-a3f2155ac7f0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:01:37.650756 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:37.736525 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:01:37.737355 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Volume volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:01:37.753079 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] deleting rbd volume volume-313d6b93-94c9-4348-90d5-a3f2155ac7f0 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:01:38.240760 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Created reservations ['691353cc-4e7e-4aaa-8c1e-ee261d086e3f', '310c93d7-d01d-4278-bfc0-bb7d3d9b853f', 'c6ce9921-b6f0-469c-aa2d-6a2a80781f0e', '205b0056-8c74-4523-a2e5-ca89d05666cf'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:01:38.317560 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:38.406102 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:01:38.496366 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:01:38.505633 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Deleted volume successfully.
Aug 27 21:01:38.533959 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-174bf038-7c40-4cf7-af61-913a024c7118 tempest-AttachSCSIVolumeTestJSON-349361316 None] Lock "cinder-313d6b93-94c9-4348-90d5-a3f2155ac7f0-delete_volume" released by "delete_volume" :: held 0.985s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:01:50.984829 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=35,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:02:02.856316 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:02:02.858353 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:02:02.945832 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:02:03.004729 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:02:10.994023 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:02:10.995536 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:02:31.019574 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:02:40.137471 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-9a95be2a-ed22-4216-9e45-bba0fbd9f3a0 tempest-ServersTestBootFromVolume-854824990 None] Terminate volume connection completed successfully.
Aug 27 21:02:40.140516 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-9a95be2a-ed22-4216-9e45-bba0fbd9f3a0 tempest-ServersTestBootFromVolume-854824990 None] Deleting attachment 3915c083-7e1d-417a-a7ee-cfd07759cc3d. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:02:40.420255 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Acquiring lock "cinder-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:02:40.430893 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Lock "cinder-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:02:40.534646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:02:40.663188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:02:40.674664 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] deleting rbd volume volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:02:41.155953 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:02:41.211224 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] deleting parent snapshot volume-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:02:41.621773 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:02:41.653697 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Created reservations ['ac067b94-5391-4850-893c-0c2672ae37da', '4a430fb6-5913-40bc-b5cf-72adf2d74bba', '50772346-fde2-40bc-91c1-5582e33035d2', '6e4cec1e-ed64-4281-a0cc-ecb1b9daa1ce'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:02:41.711628 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:02:41.748391 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:02:41.790568 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:02:41.796654 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Deleted volume successfully.
Aug 27 21:02:41.814866 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-0334e4a2-c96a-4e26-b0ba-7ac10d501b8c req-613a2676-2b39-401b-b8f6-389631e7d6a4 tempest-ServersTestBootFromVolume-854824990 None] Lock "cinder-8efe1edc-dbf3-4b4b-adf9-b3d77d2b53ee-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:03:00.997177 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=22,cinder:INSERT=4,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:03:02.860085 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:03:02.861544 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:03:02.941717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:03:03.061009 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:03:20.989607 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:03:40.993889 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:04:00.988179 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:04:02.860401 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:04:02.860962 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:04:02.931199 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:04:02.992590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:04:16.386041 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:04:16.411920 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Flow 'volume_create_manager' (cd19702a-1371-4a08-9663-24ebe8206a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:04:16.419969 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f1fe4e-027c-4fba-9406-1ede532937a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.427286 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:04:16.442536 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f1fe4e-027c-4fba-9406-1ede532937a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1741741406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b676fbc-affb-4ef6-83b6-7851850043bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fff748616a34a7db41745e7d9340353',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:04:16Z,use_quota=True,user_id='7169b8b3279c43c9a4097d6e42d2f1eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.450043 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74511b60-c2e2-4a91-8e80-8a2c685a9ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.456272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74511b60-c2e2-4a91-8e80-8a2c685a9ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.463745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0624e-1c45-4a46-9793-3a0438623156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.469792 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b0624e-1c45-4a46-9793-3a0438623156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b676fbc-affb-4ef6-83b6-7851850043bf', 'volume_name': 'volume-8b676fbc-affb-4ef6-83b6-7851850043bf', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.476851 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7a512d-b2a4-4735-be94-bf14b3e8aef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.481443 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7a512d-b2a4-4735-be94-bf14b3e8aef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.489815 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1c3d9d-19e8-4d46-a138-077adab691f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.494539 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Volume 8b676fbc-affb-4ef6-83b6-7851850043bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b676fbc-affb-4ef6-83b6-7851850043bf', 'volume_size': 1}
Aug 27 21:04:16.495209 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] creating volume 'volume-8b676fbc-affb-4ef6-83b6-7851850043bf' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:04:16.498634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:04:16.702136 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:04:16.702980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:04:16.708382 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d1c3d9d-19e8-4d46-a138-077adab691f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b676fbc-affb-4ef6-83b6-7851850043bf', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.720294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acfa17e-e88d-4e8a-8e81-39ac225a7415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:04:16.743508 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Volume volume-8b676fbc-affb-4ef6-83b6-7851850043bf (8b676fbc-affb-4ef6-83b6-7851850043bf): created successfully
Aug 27 21:04:16.749911 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acfa17e-e88d-4e8a-8e81-39ac225a7415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:04:16.755568 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Flow 'volume_create_manager' (cd19702a-1371-4a08-9663-24ebe8206a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:04:16.783140 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1851273d-08ca-4fb4-bed3-9b31c37df48e tempest-DeleteServersTestJSON-1482281639 None] Created volume successfully.
Aug 27 21:04:19.428989 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 req-28844e48-bb00-4b62-b22b-581da7ae9386 tempest-DeleteServersTestJSON-1482281639 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:04:20.963154 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 req-28844e48-bb00-4b62-b22b-581da7ae9386 tempest-DeleteServersTestJSON-1482281639 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.534s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:04:20.964030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 req-28844e48-bb00-4b62-b22b-581da7ae9386 tempest-DeleteServersTestJSON-1482281639 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8b676fbc-affb-4ef6-83b6-7851850043bf', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '8b676fbc-affb-4ef6-83b6-7851850043bf', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:04:21.022030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 req-28844e48-bb00-4b62-b22b-581da7ae9386 tempest-DeleteServersTestJSON-1482281639 None] Connection info returned from driver {'name': 'volumes/volume-8b676fbc-affb-4ef6-83b6-7851850043bf', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '8b676fbc-affb-4ef6-83b6-7851850043bf', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd5afdedd-754e-456e-b4a6-e715b3bf9353'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:04:21.117740 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-b0fdcb1e-b64b-44d6-bf7e-97da2e8d7f64 req-28844e48-bb00-4b62-b22b-581da7ae9386 tempest-DeleteServersTestJSON-1482281639 None] attachment_update completed successfully.
Aug 27 21:04:28.789168 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-4b571254-7d11-4c75-862a-cf48976305af req-46ea51c3-087a-4a2f-99ae-11f7ae23676d tempest-DeleteServersTestJSON-1482281639 None] Terminate volume connection completed successfully.
Aug 27 21:04:28.790973 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-4b571254-7d11-4c75-862a-cf48976305af req-46ea51c3-087a-4a2f-99ae-11f7ae23676d tempest-DeleteServersTestJSON-1482281639 None] Deleting attachment d5afdedd-754e-456e-b4a6-e715b3bf9353. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:04:40.985194 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=22,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:04:50.987082 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=22,cinder:UPDATE=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:00.991268 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:02.210363 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:02.241213 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (77288dc3-0b7a-462b-9837-a1b30426bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:02.253942 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcda08c-bdd8-4191-b185-9ab88b0374eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.278601 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcda08c-bdd8-4191-b185-9ab88b0374eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-507902949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d4238f72-85e4-443a-878e-4d29d9b6f272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:02Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.284855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc21ae-fbda-4155-91f9-3ee71bca591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.289668 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40cc21ae-fbda-4155-91f9-3ee71bca591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.295143 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b792fd0-5ee9-4f5f-804d-96af287cb5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.299547 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b792fd0-5ee9-4f5f-804d-96af287cb5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4238f72-85e4-443a-878e-4d29d9b6f272', 'volume_name': 'volume-d4238f72-85e4-443a-878e-4d29d9b6f272', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.304861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ffc119-bf3b-40ab-8d34-43f2780e3290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.309333 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ffc119-bf3b-40ab-8d34-43f2780e3290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.314148 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66841859-169a-475f-a1d4-e0a97dee744a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.315232 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Volume d4238f72-85e4-443a-878e-4d29d9b6f272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4238f72-85e4-443a-878e-4d29d9b6f272', 'volume_size': 1}
Aug 27 21:05:02.315706 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-d4238f72-85e4-443a-878e-4d29d9b6f272' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:02.316476 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:02.406598 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:02.407719 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:02.412420 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66841859-169a-475f-a1d4-e0a97dee744a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4238f72-85e4-443a-878e-4d29d9b6f272', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.418242 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa33de0-174a-43c2-ace5-9d5e797e042f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:02.431304 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Volume volume-d4238f72-85e4-443a-878e-4d29d9b6f272 (d4238f72-85e4-443a-878e-4d29d9b6f272): created successfully
Aug 27 21:05:02.435430 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aa33de0-174a-43c2-ace5-9d5e797e042f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:02.441056 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (77288dc3-0b7a-462b-9837-a1b30426bea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:02.452831 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9d0d4c77-e2c9-49f5-9ec9-0217d7cc7ca0 tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:02.858365 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:05:02.859094 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:02.903840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:02.973958 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:03.263126 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2778932-af71-4e76-b051-1d304467fdad tempest-VolumesActionsTest-1560717861 None] Acquiring lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272" by "attach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:03.273058 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2778932-af71-4e76-b051-1d304467fdad tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272" acquired by "attach_volume" :: waited 0.010s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:03.340951 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b2778932-af71-4e76-b051-1d304467fdad tempest-VolumesActionsTest-1560717861 None] Attaching volume d4238f72-85e4-443a-878e-4d29d9b6f272 to instance 42310c09-5e3a-43a9-9ede-bbf683949956 at mountpoint /dev/sdb on host None.
Aug 27 21:05:03.371515 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b2778932-af71-4e76-b051-1d304467fdad tempest-VolumesActionsTest-1560717861 None] Attach volume completed successfully.
Aug 27 21:05:03.389506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2778932-af71-4e76-b051-1d304467fdad tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272" released by "attach_volume" :: held 0.116s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:04.092871 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Terminate volume connection completed successfully.
Aug 27 21:05:04.136526 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Acquiring lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" by "detach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:04.150012 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:04.166420 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Detaching volume d4238f72-85e4-443a-878e-4d29d9b6f272 from instance 42310c09-5e3a-43a9-9ede-bbf683949956.
Aug 27 21:05:04.208143 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Detach volume completed successfully.
Aug 27 21:05:04.214411 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b93b4e12-17c4-4174-b44b-9716aba54ffc tempest-VolumesActionsTest-566956329 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:04.392031 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94fc207f-2a8b-46d1-98de-e14da3e14519 tempest-VolumesActionsTest-1560717861 None] Acquiring lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" by "detach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:04.403374 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94fc207f-2a8b-46d1-98de-e14da3e14519 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:04.404046 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-94fc207f-2a8b-46d1-98de-e14da3e14519 tempest-VolumesActionsTest-1560717861 None] Volume detach called, but volume not attached.
Aug 27 21:05:04.423791 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94fc207f-2a8b-46d1-98de-e14da3e14519 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:09.265032 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:09.300079 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (40bc9f73-ef61-4888-b4a8-8e077b272d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:09.319322 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b627bf34-7434-45d2-93ae-ff8799dfea4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.352790 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b627bf34-7434-45d2-93ae-ff8799dfea4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-570855040',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f9c3b524-830d-4837-89f0-1895ca10d190,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:09Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.372090 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc1c06-6451-4c2f-9c2e-dad21eb5b037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.377621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32bc1c06-6451-4c2f-9c2e-dad21eb5b037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.385048 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8461b57a-b38e-40e0-931e-4fcabb35950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.389625 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8461b57a-b38e-40e0-931e-4fcabb35950f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c3b524-830d-4837-89f0-1895ca10d190', 'volume_name': 'volume-f9c3b524-830d-4837-89f0-1895ca10d190', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.395180 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14762310-731c-42a6-be45-c644c5c17a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.401015 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14762310-731c-42a6-be45-c644c5c17a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.406129 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed520f3b-53c6-48a1-a70d-14bd34f8ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.407234 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Volume f9c3b524-830d-4837-89f0-1895ca10d190: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c3b524-830d-4837-89f0-1895ca10d190', 'volume_size': 1}
Aug 27 21:05:09.407640 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-f9c3b524-830d-4837-89f0-1895ca10d190' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:09.408484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:09.509030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:09.509793 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:09.513891 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed520f3b-53c6-48a1-a70d-14bd34f8ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c3b524-830d-4837-89f0-1895ca10d190', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.522497 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446896d6-1e26-4030-a430-2717ecb4fec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:09.534431 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Volume volume-f9c3b524-830d-4837-89f0-1895ca10d190 (f9c3b524-830d-4837-89f0-1895ca10d190): created successfully
Aug 27 21:05:09.538800 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446896d6-1e26-4030-a430-2717ecb4fec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:09.544612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (40bc9f73-ef61-4888-b4a8-8e077b272d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:09.555431 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3b4ccf62-0923-44a3-a6dc-1b9a1eb210b0 tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:10.481163 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Acquiring lock "cinder-f9c3b524-830d-4837-89f0-1895ca10d190-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:10.499188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Lock "cinder-f9c3b524-830d-4837-89f0-1895ca10d190-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:10.561967 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:10.651190 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:10.651769 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Volume volume-f9c3b524-830d-4837-89f0-1895ca10d190 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:10.661806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] deleting rbd volume volume-f9c3b524-830d-4837-89f0-1895ca10d190 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:10.958406 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Created reservations ['71d4fd96-78a7-4e7f-baaa-4b71a02f249c', '60e7f302-aa7e-4413-a889-7f8dd8d4ac16', '867f8ed2-f12f-4383-acb2-57bb2d546933', '7fdf1469-6add-4805-b281-bb030ead3cee'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:11.018952 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:11.058998 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:11.094754 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:11.100675 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Deleted volume successfully.
Aug 27 21:05:11.124723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-47d8fd6e-96aa-44f1-ab71-3387ccb6889b tempest-VolumesActionsTest-566956329 None] Lock "cinder-f9c3b524-830d-4837-89f0-1895ca10d190-delete_volume" released by "delete_volume" :: held 0.625s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:12.055975 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:12.080204 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (c37a3a5e-cf6f-4b2d-a572-74368a0d33e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:12.086493 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1389fe68-67d5-4131-a3e3-7941ad4670d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.104811 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1389fe68-67d5-4131-a3e3-7941ad4670d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1681052630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f87569de-d3e6-492e-bd8e-cf49c93ff489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:12Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.110990 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b957745-3770-45c9-b401-132abd6a452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.115099 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b957745-3770-45c9-b401-132abd6a452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.120652 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac509478-729f-4748-9e61-c0bd1e94038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.124599 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac509478-729f-4748-9e61-c0bd1e94038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f87569de-d3e6-492e-bd8e-cf49c93ff489', 'volume_name': 'volume-f87569de-d3e6-492e-bd8e-cf49c93ff489', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.129310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaeb39e-0af7-4d24-8c33-bee8d6f377f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.133259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaeb39e-0af7-4d24-8c33-bee8d6f377f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.137801 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a533d17a-e842-4367-b43b-1acdd3d2f256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.138857 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Volume f87569de-d3e6-492e-bd8e-cf49c93ff489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f87569de-d3e6-492e-bd8e-cf49c93ff489', 'volume_size': 1}
Aug 27 21:05:12.139249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-f87569de-d3e6-492e-bd8e-cf49c93ff489' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:12.140038 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:12.229519 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:12.230035 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:12.233729 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a533d17a-e842-4367-b43b-1acdd3d2f256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f87569de-d3e6-492e-bd8e-cf49c93ff489', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.238633 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de9468-3dcb-4877-ac57-a7190998bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:12.249534 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Volume volume-f87569de-d3e6-492e-bd8e-cf49c93ff489 (f87569de-d3e6-492e-bd8e-cf49c93ff489): created successfully
Aug 27 21:05:12.254030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23de9468-3dcb-4877-ac57-a7190998bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:12.259537 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (c37a3a5e-cf6f-4b2d-a572-74368a0d33e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:12.276580 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d91eb219-9fcc-4b3c-9605-2ddef961ebfd tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:13.300010 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Acquiring lock "cinder-f87569de-d3e6-492e-bd8e-cf49c93ff489-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:13.323256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Lock "cinder-f87569de-d3e6-492e-bd8e-cf49c93ff489-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:13.402748 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:13.516639 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:13.517069 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Volume volume-f87569de-d3e6-492e-bd8e-cf49c93ff489 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:13.532162 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] deleting rbd volume volume-f87569de-d3e6-492e-bd8e-cf49c93ff489 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:14.097891 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Created reservations ['da4a0f63-0546-4e3f-97a6-d360eea2d08d', 'cf3490d6-d69b-4a73-a0d5-a65a7871aacc', 'a63f5d67-99a3-4dad-b593-de16ffae18b9', 'ead3cf0a-1801-49a3-8bb8-96095712c9f6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:14.183968 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:14.262053 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:14.335751 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:14.341946 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Deleted volume successfully.
Aug 27 21:05:14.362603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ecaed10-7d6c-4da6-b323-28d1747e3020 tempest-VolumesActionsTest-566956329 None] Lock "cinder-f87569de-d3e6-492e-bd8e-cf49c93ff489-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:15.099196 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:15.161450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (5c3941f4-a371-45c3-9f80-b1dae16bd036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:15.202571 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3e793e-3811-4d4f-a41b-2b681d3418c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.272606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3e793e-3811-4d4f-a41b-2b681d3418c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394675517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3260a30c-a835-4386-8fa1-1eb4ca692995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:15Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.280050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509ddbd0-faad-4f64-9ef0-c60dfc690c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.285165 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509ddbd0-faad-4f64-9ef0-c60dfc690c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.291686 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fdc41c-e659-4fa1-8212-41b53bd5933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.297791 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45fdc41c-e659-4fa1-8212-41b53bd5933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3260a30c-a835-4386-8fa1-1eb4ca692995', 'volume_name': 'volume-3260a30c-a835-4386-8fa1-1eb4ca692995', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.311134 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4286917-395d-443f-bc7d-e488407fedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.316325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4286917-395d-443f-bc7d-e488407fedc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.351837 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ddc8d7-dac9-4a7f-a4c9-9a174c4f67fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.354048 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Volume 3260a30c-a835-4386-8fa1-1eb4ca692995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3260a30c-a835-4386-8fa1-1eb4ca692995', 'volume_size': 1}
Aug 27 21:05:15.357606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-3260a30c-a835-4386-8fa1-1eb4ca692995' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:15.360770 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:15.532690 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:15.533067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:15.538543 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ddc8d7-dac9-4a7f-a4c9-9a174c4f67fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3260a30c-a835-4386-8fa1-1eb4ca692995', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.544002 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72473b80-ebd6-4dca-a6d9-9223733dca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:15.559432 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Volume volume-3260a30c-a835-4386-8fa1-1eb4ca692995 (3260a30c-a835-4386-8fa1-1eb4ca692995): created successfully
Aug 27 21:05:15.565129 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72473b80-ebd6-4dca-a6d9-9223733dca60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:15.572302 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (5c3941f4-a371-45c3-9f80-b1dae16bd036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:15.588600 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-dabad908-800e-4008-bb01-2c51b21abcf5 tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:16.486269 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Acquiring lock "cinder-3260a30c-a835-4386-8fa1-1eb4ca692995-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:16.530200 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Lock "cinder-3260a30c-a835-4386-8fa1-1eb4ca692995-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:16.597024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:16.697601 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:16.698153 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Volume volume-3260a30c-a835-4386-8fa1-1eb4ca692995 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:16.710878 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] deleting rbd volume volume-3260a30c-a835-4386-8fa1-1eb4ca692995 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:17.141577 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=63,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:17.153549 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Created reservations ['c4cc6a0a-c804-4319-b821-1a8825a45e01', '76dd9109-98ff-4dfa-8756-85c8311c5869', '41c25d83-7da4-42de-91e6-62cc863fbd16', '1a9fa23f-142c-4cea-b5ab-fc1cdf1216f6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:17.162852 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:17.222124 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:17.267027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:17.314159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:17.320067 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Deleted volume successfully.
Aug 27 21:05:17.342947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8f75a58a-99c4-4064-8344-eb3ba5b514a1 tempest-VolumesActionsTest-566956329 None] Lock "cinder-3260a30c-a835-4386-8fa1-1eb4ca692995-delete_volume" released by "delete_volume" :: held 0.816s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:18.149932 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:18.174660 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (53efda23-0508-421e-bed1-3ca2d57e517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:18.182327 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a1f50-2742-4f81-ba04-c1bd4c407e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.201613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199a1f50-2742-4f81-ba04-c1bd4c407e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-523665331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b7ab84a-5fd7-4a56-b724-617710d1797f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:18Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.207717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bddaa0-b617-4d83-bd56-fa356a4e139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.212090 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bddaa0-b617-4d83-bd56-fa356a4e139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.217643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbf21c-571a-48b7-8d89-adf5c90fb7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.221865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fbf21c-571a-48b7-8d89-adf5c90fb7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7ab84a-5fd7-4a56-b724-617710d1797f', 'volume_name': 'volume-8b7ab84a-5fd7-4a56-b724-617710d1797f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.227592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954b965d-4765-4080-b602-41b36f0c2397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.231703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954b965d-4765-4080-b602-41b36f0c2397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.236703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801b2faa-ffea-48fc-86ba-34e8146c0b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.237925 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Volume 8b7ab84a-5fd7-4a56-b724-617710d1797f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7ab84a-5fd7-4a56-b724-617710d1797f', 'volume_size': 1}
Aug 27 21:05:18.238426 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-8b7ab84a-5fd7-4a56-b724-617710d1797f' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:18.239299 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:18.336036 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:18.336428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:18.340240 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (801b2faa-ffea-48fc-86ba-34e8146c0b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7ab84a-5fd7-4a56-b724-617710d1797f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.345108 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057823da-a237-416d-aeda-eaef48447e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:18.356328 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Volume volume-8b7ab84a-5fd7-4a56-b724-617710d1797f (8b7ab84a-5fd7-4a56-b724-617710d1797f): created successfully
Aug 27 21:05:18.362487 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057823da-a237-416d-aeda-eaef48447e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:18.369798 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (53efda23-0508-421e-bed1-3ca2d57e517d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:18.384585 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-550bdda1-800f-4e38-84c1-41827c7e99ca tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:19.377874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Acquiring lock "cinder-8b7ab84a-5fd7-4a56-b724-617710d1797f-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:19.408279 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Lock "cinder-8b7ab84a-5fd7-4a56-b724-617710d1797f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:19.470387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:19.529876 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:19.530495 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Volume volume-8b7ab84a-5fd7-4a56-b724-617710d1797f is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:19.540469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] deleting rbd volume volume-8b7ab84a-5fd7-4a56-b724-617710d1797f {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:19.874794 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Created reservations ['9e61a20b-90b0-4cef-a0d5-a164b748f67b', 'd9f4ba99-af72-4500-9d70-7092b55a5327', '30b773c5-89f9-45ea-9d6e-f6ac3d65f242', 'c071e40c-7a3f-4315-9abf-b865af3056d8'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:19.929939 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:20.009744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:20.081764 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:20.087224 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Deleted volume successfully.
Aug 27 21:05:20.106131 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-319f18ae-9540-4dc3-b69c-c33f7cbfee61 tempest-VolumesActionsTest-566956329 None] Lock "cinder-8b7ab84a-5fd7-4a56-b724-617710d1797f-delete_volume" released by "delete_volume" :: held 0.698s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:21.158772 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:21.203608 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (b9d89106-26d3-4dd3-a772-61786ae3d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:21.213752 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f7126-87a2-4f60-afbe-2dcecd5d95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.239481 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f7126-87a2-4f60-afbe-2dcecd5d95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1151456073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8904cdc-e972-4ecd-a6f0-3c08d473206a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d783e6e60ee46e3841e787bc32692d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:21Z,use_quota=True,user_id='2080e683fd744eda8f9f2ad156e6b045',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.245670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a22a0d-abe5-440a-8be5-4592b6d5aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.249680 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a22a0d-abe5-440a-8be5-4592b6d5aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.255192 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295fe4a-05ce-4213-9740-c3f9906d3d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.278507 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d295fe4a-05ce-4213-9740-c3f9906d3d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8904cdc-e972-4ecd-a6f0-3c08d473206a', 'volume_name': 'volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.278507 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f7199d-b677-4b07-8d9b-0b0878eec6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.278507 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25f7199d-b677-4b07-8d9b-0b0878eec6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.280198 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da9c72a-aeec-4250-bc26-284109e969ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.280198 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Volume f8904cdc-e972-4ecd-a6f0-3c08d473206a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a', 'volume_size': 1}
Aug 27 21:05:21.280198 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] creating volume 'volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:21.280198 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:21.390542 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:21.390842 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:21.394828 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da9c72a-aeec-4250-bc26-284109e969ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.400531 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c5a698-7a33-405f-b77b-387cd4a4a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:21.415029 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Volume volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a (f8904cdc-e972-4ecd-a6f0-3c08d473206a): created successfully
Aug 27 21:05:21.420781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c5a698-7a33-405f-b77b-387cd4a4a177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:21.427349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Flow 'volume_create_manager' (b9d89106-26d3-4dd3-a772-61786ae3d04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:21.438689 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2536e2e7-aeae-424e-903b-97b00d3c1c9c tempest-VolumesActionsTest-1560717861 None] Created volume successfully.
Aug 27 21:05:22.837670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Acquiring lock "cinder-f8904cdc-e972-4ecd-a6f0-3c08d473206a-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:22.872065 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-f8904cdc-e972-4ecd-a6f0-3c08d473206a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:22.969160 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:23.069039 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:23.069603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Volume volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:23.081779 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] deleting rbd volume volume-f8904cdc-e972-4ecd-a6f0-3c08d473206a {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:23.510147 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Created reservations ['b097a24c-1d71-4e37-9416-b55a48a6c38b', '1874cb01-6d95-4bbd-b456-e7baf4521522', '94932ebd-07dd-4261-a22a-81f6d29ee573', 'e15f8f30-efef-4591-898d-96864323274a'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:23.564296 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:23.625410 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:23.679931 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:23.683978 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Deleted volume successfully.
Aug 27 21:05:23.697481 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-46cfc507-e8e0-4851-9145-6a51143d66f2 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-f8904cdc-e972-4ecd-a6f0-3c08d473206a-delete_volume" released by "delete_volume" :: held 0.825s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:24.202327 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Acquiring lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:24.229749 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:24.310159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:24.399967 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:24.400390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Volume volume-d4238f72-85e4-443a-878e-4d29d9b6f272 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:24.413269 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] deleting rbd volume volume-d4238f72-85e4-443a-878e-4d29d9b6f272 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:24.780047 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Created reservations ['f5dc49b4-16bb-42cb-918c-639adaa2f3e7', 'ac4c4dbe-59a4-4962-88c8-06fb520516fb', '107aa629-d2cd-40cb-a770-9636547b96b3', '32c62da7-0287-4112-bb2e-9cae3ee8f9df'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:24.844545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:24.893738 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:24.963474 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:24.969293 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Deleted volume successfully.
Aug 27 21:05:24.992884 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-18ad0ec3-a937-4610-883c-38f9252fd644 tempest-VolumesActionsTest-1560717861 None] Lock "cinder-d4238f72-85e4-443a-878e-4d29d9b6f272-delete_volume" released by "delete_volume" :: held 0.764s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:33.718717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:33.800033 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Flow 'volume_create_manager' (62e9e9f4-2df1-40a4-8218-dda430e88ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:33.814441 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8727fe1-af26-4196-a022-00410051cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:33.874589 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8727fe1-af26-4196-a022-00410051cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1226075509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c3be0e6b-a951-4099-b19a-1af0bc914902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9101ce487906431dbbfa02b753b5a83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:34Z,use_quota=True,user_id='c6df1ada8d914bc3bcc11de462a697c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:33.885757 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d4ec4-4a36-427a-8b76-5187c87396e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:33.891232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d54d4ec4-4a36-427a-8b76-5187c87396e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:33.900745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d10883-e323-465d-a78b-eaa0880894d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:33.905868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19d10883-e323-465d-a78b-eaa0880894d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3be0e6b-a951-4099-b19a-1af0bc914902', 'volume_name': 'volume-c3be0e6b-a951-4099-b19a-1af0bc914902', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:33.912506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778ffc4e-7b2e-40df-a4af-af519968d01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:33.919290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778ffc4e-7b2e-40df-a4af-af519968d01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:33.938806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0566a4-66ef-4d3c-8821-ad36c714d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:33.940133 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Volume c3be0e6b-a951-4099-b19a-1af0bc914902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3be0e6b-a951-4099-b19a-1af0bc914902', 'volume_size': 1}
Aug 27 21:05:33.941744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] creating volume 'volume-c3be0e6b-a951-4099-b19a-1af0bc914902' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:33.942680 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:34.065355 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:34.065739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:34.069398 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0566a4-66ef-4d3c-8821-ad36c714d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3be0e6b-a951-4099-b19a-1af0bc914902', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:34.080519 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce34e30e-ffe8-4b06-9497-bf7b41fda1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:34.092526 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Volume volume-c3be0e6b-a951-4099-b19a-1af0bc914902 (c3be0e6b-a951-4099-b19a-1af0bc914902): created successfully
Aug 27 21:05:34.100348 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce34e30e-ffe8-4b06-9497-bf7b41fda1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:34.110207 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Flow 'volume_create_manager' (62e9e9f4-2df1-40a4-8218-dda430e88ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:34.145685 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c5f56361-b98e-4f0e-890f-6569e25d4389 tempest-VolumesTransfersTest-228513178 None] Created volume successfully.
Aug 27 21:05:36.078297 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-94bcfb1d-4995-4425-9a4c-09e490a75e0f tempest-VolumesTransfersTest-1478714564 None] Transfer volume completed successfully.
Aug 27 21:05:36.951610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Acquiring lock "cinder-c3be0e6b-a951-4099-b19a-1af0bc914902-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:36.976399 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Lock "cinder-c3be0e6b-a951-4099-b19a-1af0bc914902-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:36.993771 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=44,cinder:SELECT=50,cinder:DELETE=1,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:37.000679 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=59,cinder:DELETE=6,cinder:UPDATE=28,cinder:INSERT=7 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:05:37.108872 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:37.274338 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:37.274854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Volume volume-c3be0e6b-a951-4099-b19a-1af0bc914902 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:37.296373 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] deleting rbd volume volume-c3be0e6b-a951-4099-b19a-1af0bc914902 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:37.365270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:37.413500 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (1c8d451d-034f-4df3-ae41-25e3ae10cdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:37.432362 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc7c31a-6adc-4b81-ad3d-95cb62046bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.472339 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc7c31a-6adc-4b81-ad3d-95cb62046bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-949389175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b4c86f3463480ab7ea7fc27c7e3c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:37Z,use_quota=True,user_id='f0df3ca755314bdc8e8b236abb0924b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.492927 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6c7e5-c0fa-484c-97b3-7590c5a5b90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.504845 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f6c7e5-c0fa-484c-97b3-7590c5a5b90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.525523 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b2bf16-0e36-4c7e-9950-4ccd22d2860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.533805 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1b2bf16-0e36-4c7e-9950-4ccd22d2860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'volume_name': 'volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.564684 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb979d7-b957-4342-aa75-d3c86178c000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.589701 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb979d7-b957-4342-aa75-d3c86178c000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.611307 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c16dbd1-5223-46ed-bf02-6239c68ae5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.613026 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Volume 6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'volume_size': 1}
Aug 27 21:05:37.613616 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] creating volume 'volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:37.614462 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:37.871314 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:37.872494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:37.877988 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c16dbd1-5223-46ed-bf02-6239c68ae5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.892013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca25f2-4a0a-46bf-b475-cacf5bb41149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:37.915785 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 (6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495): created successfully
Aug 27 21:05:37.920934 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ca25f2-4a0a-46bf-b475-cacf5bb41149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:37.929311 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (1c8d451d-034f-4df3-ae41-25e3ae10cdab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:37.959804 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b8c793d2-b107-425f-92e1-a5d033d3282d tempest-AttachVolumeNegativeTest-737699077 None] Created volume successfully.
Aug 27 21:05:38.008892 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Created reservations ['c8e152e9-b175-425c-8880-698ad6917413', '03846255-3c93-4581-b317-88951fdf10d7', '07268138-a0ce-4250-b007-06822e16f8d9', 'db172419-4311-4db4-8922-ab41fd43938c'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:38.120253 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:38.203130 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:38.329986 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:38.334558 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Deleted volume successfully.
Aug 27 21:05:38.362415 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-11ed4edf-d3e9-4d10-9c96-79ef89bee761 tempest-VolumesTransfersTest-2064789749 None] Lock "cinder-c3be0e6b-a951-4099-b19a-1af0bc914902-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:38.962278 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:39.008861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Flow 'volume_create_manager' (85efe1d7-fcce-4fa7-9b79-78a92797021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:39.065787 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5861e40-d2c6-40e0-ab31-ee901b997be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.158509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5861e40-d2c6-40e0-ab31-ee901b997be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-712731715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f2bbb0de-4eda-45fb-9b9a-5337538f6f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9101ce487906431dbbfa02b753b5a83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:39Z,use_quota=True,user_id='c6df1ada8d914bc3bcc11de462a697c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.173440 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e103f571-0a05-4263-8cc1-aed5d8479543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.187324 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e103f571-0a05-4263-8cc1-aed5d8479543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.199679 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7beb10-3c21-476b-b96a-f2437bfb6cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.208976 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7beb10-3c21-476b-b96a-f2437bfb6cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2bbb0de-4eda-45fb-9b9a-5337538f6f65', 'volume_name': 'volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.256046 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec6e7aa-f6ab-492a-8e24-2c25a287edc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.267142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec6e7aa-f6ab-492a-8e24-2c25a287edc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.276634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6ceb6-e6c0-490f-bd32-7d70a3b81ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.277941 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Volume f2bbb0de-4eda-45fb-9b9a-5337538f6f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65', 'volume_size': 1}
Aug 27 21:05:39.278531 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] creating volume 'volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:39.279514 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:39.466218 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:39.466692 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:39.471919 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abf6ceb6-e6c0-490f-bd32-7d70a3b81ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.481782 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57528cc-f341-48fa-84ba-2f3b42914061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:39.523893 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Volume volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65 (f2bbb0de-4eda-45fb-9b9a-5337538f6f65): created successfully
Aug 27 21:05:39.533595 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57528cc-f341-48fa-84ba-2f3b42914061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:39.564514 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Flow 'volume_create_manager' (85efe1d7-fcce-4fa7-9b79-78a92797021a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:39.589820 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-95d5be11-7731-4433-8eaa-c1a1fb079b4f tempest-VolumesTransfersTest-228513178 None] Created volume successfully.
Aug 27 21:05:40.150044 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c req-b1f6c8b8-aace-4691-bb81-4b24842f0b26 tempest-AttachVolumeNegativeTest-737699077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:05:40.530941 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Acquiring lock "cinder-f2bbb0de-4eda-45fb-9b9a-5337538f6f65-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:05:40.562787 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Lock "cinder-f2bbb0de-4eda-45fb-9b9a-5337538f6f65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:05:40.633342 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:40.737806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:05:40.738255 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Volume volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:05:40.765165 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] deleting rbd volume volume-f2bbb0de-4eda-45fb-9b9a-5337538f6f65 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:05:41.455537 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Created reservations ['7db6ba1a-44bc-4a58-a2f7-7532f1e14a03', '8d80e7c4-5bce-4e6a-8a79-c44aba070568', '4f3f3739-2187-41b7-bdf1-0fe8c0fc4644', '42d5642b-6fbb-45c8-8dc4-6d4cd96b60ca'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:05:41.541256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:41.679789 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:41.781692 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:05:41.792152 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Deleted volume successfully.
Aug 27 21:05:41.825050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3a861df9-8f90-45a1-9e77-b42afcce3a10 tempest-VolumesTransfersTest-2064789749 None] Lock "cinder-f2bbb0de-4eda-45fb-9b9a-5337538f6f65-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:05:42.154573 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c req-b1f6c8b8-aace-4691-bb81-4b24842f0b26 tempest-AttachVolumeNegativeTest-737699077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.004s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:05:42.157014 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c req-b1f6c8b8-aace-4691-bb81-4b24842f0b26 tempest-AttachVolumeNegativeTest-737699077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:05:42.216191 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c req-b1f6c8b8-aace-4691-bb81-4b24842f0b26 tempest-AttachVolumeNegativeTest-737699077 None] Connection info returned from driver {'name': 'volumes/volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '07585c5a-82d4-46c6-951c-03c58eafd285'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:05:42.342017 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-f8f53923-848e-4cd9-ab4a-1140abdd4f6c req-b1f6c8b8-aace-4691-bb81-4b24842f0b26 tempest-AttachVolumeNegativeTest-737699077 None] attachment_update completed successfully.
Aug 27 21:05:44.170936 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:44.278555 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Flow 'volume_create_manager' (cb42a71f-2029-4f2f-a5d8-dfd6d87ab1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:44.301870 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d435293-0ba0-43aa-8619-4a866d75cdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.337834 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d435293-0ba0-43aa-8619-4a866d75cdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-448240462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=acd305a5-b2c7-4635-a2cf-500ae342a530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ebee97f90d4fafbcadeb4e8279c8f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:44Z,use_quota=True,user_id='5d8126f174f5424ebdcc1f062ffb9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.353617 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d342a61-2572-494b-a2a3-a29d1f60eae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.358019 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d342a61-2572-494b-a2a3-a29d1f60eae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.368741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adac2226-eb98-4911-9665-81dcea812721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.406009 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adac2226-eb98-4911-9665-81dcea812721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd305a5-b2c7-4635-a2cf-500ae342a530', 'volume_name': 'volume-acd305a5-b2c7-4635-a2cf-500ae342a530', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.411657 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df2116-9c33-44c5-afbe-7b7691f61379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.421498 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2df2116-9c33-44c5-afbe-7b7691f61379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.438420 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5a01b-1950-4f98-9392-3c92e9e2264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.446619 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume acd305a5-b2c7-4635-a2cf-500ae342a530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd305a5-b2c7-4635-a2cf-500ae342a530', 'volume_size': 1}
Aug 27 21:05:44.449207 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] creating volume 'volume-acd305a5-b2c7-4635-a2cf-500ae342a530' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:44.454004 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:44.659900 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:44.660454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:44.666103 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe5a01b-1950-4f98-9392-3c92e9e2264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd305a5-b2c7-4635-a2cf-500ae342a530', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.676478 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f05387f-c275-4af5-95f4-e2419146ca04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:44.701081 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume volume-acd305a5-b2c7-4635-a2cf-500ae342a530 (acd305a5-b2c7-4635-a2cf-500ae342a530): created successfully
Aug 27 21:05:44.707028 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f05387f-c275-4af5-95f4-e2419146ca04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:44.727232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Flow 'volume_create_manager' (cb42a71f-2029-4f2f-a5d8-dfd6d87ab1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:44.783961 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-cd27de1c-ad2d-4b17-b711-fa12a56541d5 tempest-ServerRescueNegativeTestJSON-904246104 None] Created volume successfully.
Aug 27 21:05:59.023523 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:05:59.078850 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Flow 'volume_create_manager' (806cc517-9333-4e5a-abae-ef12a2695b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:59.094502 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f4cb3-51a0-4407-9b9d-5d5e93c77df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.255264 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb5f4cb3-51a0-4407-9b9d-5d5e93c77df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-296815800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9e4987b8-20ca-4e28-bcc2-0409d9e0a179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73be5481ae6489cb44d3f4fcafb117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:05:59Z,use_quota=True,user_id='b1d406263f4f4eba9395cca9bd791010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.260983 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1ef63-9083-4328-b1ce-a06d23899a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.284974 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1ef63-9083-4328-b1ce-a06d23899a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.291495 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a3c146-99da-44da-b916-0f5c1bf48e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.320642 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a3c146-99da-44da-b916-0f5c1bf48e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4987b8-20ca-4e28-bcc2-0409d9e0a179', 'volume_name': 'volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.326070 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7349f54-6e58-4a8a-ba58-123e31e1a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.330405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7349f54-6e58-4a8a-ba58-123e31e1a196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.360027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a2505e-3e1a-4635-a422-5e273a0f5ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.361157 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Volume 9e4987b8-20ca-4e28-bcc2-0409d9e0a179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179', 'volume_size': 1}
Aug 27 21:05:59.361550 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] creating volume 'volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:05:59.362214 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:05:59.555565 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:05:59.556385 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:05:59.560584 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a2505e-3e1a-4635-a422-5e273a0f5ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.575586 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585eefd2-178f-444e-b469-43466280dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:05:59.599413 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Volume volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179 (9e4987b8-20ca-4e28-bcc2-0409d9e0a179): created successfully
Aug 27 21:05:59.604592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585eefd2-178f-444e-b469-43466280dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:05:59.621839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Flow 'volume_create_manager' (806cc517-9333-4e5a-abae-ef12a2695b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:05:59.650969 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-642af567-5121-4fc3-bc05-a9d29ac98f4b tempest-VolumesTransfersV357Test-1250239114 None] Created volume successfully.
Aug 27 21:06:01.909855 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-dc66160a-6530-444c-8fd1-364db2a8d905 tempest-VolumesTransfersV357Test-1307434470 None] Transfer volume completed successfully.
Aug 27 21:06:02.740703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Acquiring lock "cinder-9e4987b8-20ca-4e28-bcc2-0409d9e0a179-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:02.786892 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Lock "cinder-9e4987b8-20ca-4e28-bcc2-0409d9e0a179-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:02.858486 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:06:02.859963 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:02.942134 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:03.024869 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:03.063934 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:03.190871 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:06:03.191292 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Volume volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:03.208845 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] deleting rbd volume volume-9e4987b8-20ca-4e28-bcc2-0409d9e0a179 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:06:03.955508 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Created reservations ['2c298a30-d6e2-4b7a-82b6-18b7132474ec', 'd9bbcbd1-08f8-40bd-b4cc-7e6ca50554fb', '0f1b9b4d-0f71-447b-ad7b-50a6ebd3da3d', '085bd6a2-4bc6-4a40-b60b-c840cc4aadf4'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:06:03.968465 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=32,cinder:SELECT=59,cinder:INSERT=7,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:04.010761 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=64,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:04.058595 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:04.138727 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:04.222715 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:04.227274 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Deleted volume successfully.
Aug 27 21:06:04.262854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3f4fab1f-493b-4718-88f5-0b1844bb6df1 tempest-VolumesTransfersV357Test-1021009873 None] Lock "cinder-9e4987b8-20ca-4e28-bcc2-0409d9e0a179-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:05.960875 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:06.062885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Flow 'volume_create_manager' (11a784dd-b89d-42ee-b57c-a41225db2f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:06.097226 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57650a93-8600-4ae3-a04c-b0a6a5550aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.174069 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57650a93-8600-4ae3-a04c-b0a6a5550aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231464351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f49e5318-d9ec-46b3-83ab-e5b52d40f386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73be5481ae6489cb44d3f4fcafb117b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:06Z,use_quota=True,user_id='b1d406263f4f4eba9395cca9bd791010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.203261 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80b93ce-2a44-4d92-b257-528345fe29f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.220000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80b93ce-2a44-4d92-b257-528345fe29f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.238750 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133bb256-c519-4cf7-8d36-e8695c4e71b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.246460 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133bb256-c519-4cf7-8d36-e8695c4e71b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f49e5318-d9ec-46b3-83ab-e5b52d40f386', 'volume_name': 'volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.271591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdc214b-5434-4c17-8dc2-e41b3ae49b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.280990 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdc214b-5434-4c17-8dc2-e41b3ae49b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.314044 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5511faa4-b393-46b4-bae2-1b2064b3439d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.331544 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Volume f49e5318-d9ec-46b3-83ab-e5b52d40f386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386', 'volume_size': 1}
Aug 27 21:06:06.334087 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] creating volume 'volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:06.337949 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:06.572061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:06.572425 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:06.577947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5511faa4-b393-46b4-bae2-1b2064b3439d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.601631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d9f3c4-c8c0-4a50-9578-f7412a96bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:06.639943 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Volume volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386 (f49e5318-d9ec-46b3-83ab-e5b52d40f386): created successfully
Aug 27 21:06:06.644683 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d9f3c4-c8c0-4a50-9578-f7412a96bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:06.652281 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Flow 'volume_create_manager' (11a784dd-b89d-42ee-b57c-a41225db2f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:06.664256 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6ec82b8b-bac3-4809-9f49-114758609e10 tempest-VolumesTransfersV357Test-1250239114 None] Created volume successfully.
Aug 27 21:06:07.505103 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Acquiring lock "cinder-f49e5318-d9ec-46b3-83ab-e5b52d40f386-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:07.532281 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Lock "cinder-f49e5318-d9ec-46b3-83ab-e5b52d40f386-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:07.590065 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:07.723125 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:06:07.724843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Volume volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:07.738980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] deleting rbd volume volume-f49e5318-d9ec-46b3-83ab-e5b52d40f386 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:06:07.822317 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:07.875084 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (3cf00068-f6ca-4c99-9822-c2cd179aec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:07.886478 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c159e5b-7e94-405c-b9ee-61e489999b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:07.926991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c159e5b-7e94-405c-b9ee-61e489999b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1828503954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4e2488ca-6bf7-4eec-90ad-0aee15955f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9abfa1d159f4e2cb2ddbbcd80f3615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:08Z,use_quota=True,user_id='1eb7e6ff68c14b3f8f6ce22a6926920b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:07.936667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920a45c-3a4c-4743-a20b-137b99587d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:07.944021 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6920a45c-3a4c-4743-a20b-137b99587d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:07.955319 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7423b23-8a61-4aa2-b373-a0e66574f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:08.130602 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7423b23-8a61-4aa2-b373-a0e66574f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'volume_name': 'volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac5072b0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:08.143672 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39b02e3-c243-4ad3-ad7d-8bd2c4b30498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:08.148349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39b02e3-c243-4ad3-ad7d-8bd2c4b30498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:08.152994 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc1ff65-e8e8-405b-912c-c1f0f864cf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:08.154726 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume 4e2488ca-6bf7-4eec-90ad-0aee15955f29: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac5072b0>}
Aug 27 21:06:08.154726 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Cloning 4e2488ca-6bf7-4eec-90ad-0aee15955f29 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:06:08.166568 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:08.181105 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:08.208251 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 6, 8, 195869)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:06:08.210772 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:06:08.211432 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:06:08.216783 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.036s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:08.217834 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:06:08.228978 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 6, 8, 223916)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:06:08.229390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:06:08.229786 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:06:08.258766 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:08.363875 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] creating snapshot='volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:06:09.294332 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29.clone_snap' to 'volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:06:09.416061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Created reservations ['0ccd607e-528b-48cc-a310-68f4c3c9f58e', '3274c2de-03a9-4989-b0b1-d8d9385d62e6', 'b81536d1-8440-44d2-a42b-9d79f7776ef4', 'ea381275-15d5-4022-8def-6e97bb1359d6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:06:09.619534 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:09.623485 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:09.623840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:09.674847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:06:09.675074 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Marking volume 4e2488ca-6bf7-4eec-90ad-0aee15955f29 as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:06:09.698852 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to 4e2488ca-6bf7-4eec-90ad-0aee15955f29. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:06:09.699348 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Creating volume glance metadata for volume 4e2488ca-6bf7-4eec-90ad-0aee15955f29 backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:06:09.913468 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcc1ff65-e8e8-405b-912c-c1f0f864cf23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac5072b0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:09.924037 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2901b2-9940-47c4-9bb0-f540e98b9898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:09.955772 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29 (4e2488ca-6bf7-4eec-90ad-0aee15955f29): created successfully
Aug 27 21:06:09.969948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2901b2-9940-47c4-9bb0-f540e98b9898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:09.985621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (3cf00068-f6ca-4c99-9822-c2cd179aec4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:10.008875 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6bdaa2c4-d159-43a2-aed4-542152c7825c tempest-TaggedBootDevicesTest_v242-1042837722 None] Created volume successfully.
Aug 27 21:06:10.021993 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:10.137323 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:10.250590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:10.259855 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Deleted volume successfully.
Aug 27 21:06:10.295081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-29a4def0-06b6-4c11-bdb9-9aed66e73e88 tempest-VolumesTransfersV357Test-1021009873 None] Lock "cinder-f49e5318-d9ec-46b3-83ab-e5b52d40f386-delete_volume" released by "delete_volume" :: held 2.763s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:11.720662 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:11.771868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (c0e9fb11-f078-464e-82d6-1e5886e334d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:11.781536 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c067e3b4-fac6-4db3-9fa4-c5edb2e1d962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:11.826670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c067e3b4-fac6-4db3-9fa4-c5edb2e1d962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1005725870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7bb09a2e-9d97-407e-a8bf-817e7b438724,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9abfa1d159f4e2cb2ddbbcd80f3615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:12Z,use_quota=True,user_id='1eb7e6ff68c14b3f8f6ce22a6926920b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:11.840849 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c88991f-59de-4e6a-ae2b-b0e04b3a2101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:11.854149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c88991f-59de-4e6a-ae2b-b0e04b3a2101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:11.866908 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b700da97-7f99-4296-8fdb-12ee2e353328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:11.875467 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b700da97-7f99-4296-8fdb-12ee2e353328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb09a2e-9d97-407e-a8bf-817e7b438724', 'volume_name': 'volume-7bb09a2e-9d97-407e-a8bf-817e7b438724', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:11.892572 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84125472-7106-4730-b0d5-b27d532d3eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:11.900172 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84125472-7106-4730-b0d5-b27d532d3eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:11.913398 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f778be27-92f9-45d8-aae1-b1fa28c26ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:11.917547 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume 7bb09a2e-9d97-407e-a8bf-817e7b438724: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb09a2e-9d97-407e-a8bf-817e7b438724', 'volume_size': 1}
Aug 27 21:06:11.917951 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] creating volume 'volume-7bb09a2e-9d97-407e-a8bf-817e7b438724' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:11.918733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:12.108469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:12.109316 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:12.114560 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f778be27-92f9-45d8-aae1-b1fa28c26ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb09a2e-9d97-407e-a8bf-817e7b438724', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:12.126491 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb587cfa-ba90-4f65-b485-364530874925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:12.160063 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-7bb09a2e-9d97-407e-a8bf-817e7b438724 (7bb09a2e-9d97-407e-a8bf-817e7b438724): created successfully
Aug 27 21:06:12.167495 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb587cfa-ba90-4f65-b485-364530874925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:12.178701 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (c0e9fb11-f078-464e-82d6-1e5886e334d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:12.204484 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-633ffb34-9f88-40d3-b279-c3071d4aede7 tempest-TaggedBootDevicesTest_v242-1042837722 None] Created volume successfully.
Aug 27 21:06:13.508031 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:13.545335 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (6c2a8fd6-54c9-4d20-98cb-8980c75d591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:13.574470 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b326f96b-6af5-4592-a050-8bb17b75ca6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.625691 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b326f96b-6af5-4592-a050-8bb17b75ca6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-782572097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=80f8feb0-5bbf-4857-8078-a818ff55caea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f9abfa1d159f4e2cb2ddbbcd80f3615e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:13Z,use_quota=True,user_id='1eb7e6ff68c14b3f8f6ce22a6926920b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.646424 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfa45df-ed4a-4d28-ab94-0c7aaba3e59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.666363 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfa45df-ed4a-4d28-ab94-0c7aaba3e59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.677625 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139e2b6a-df73-4ea5-86f7-7b60dfe8e966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.692238 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (139e2b6a-df73-4ea5-86f7-7b60dfe8e966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f8feb0-5bbf-4857-8078-a818ff55caea', 'volume_name': 'volume-80f8feb0-5bbf-4857-8078-a818ff55caea', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.710205 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a10e57-b02a-42a2-9854-4732f52eca88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.720142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a10e57-b02a-42a2-9854-4732f52eca88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.739916 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7614e75-e122-4dc6-af93-06191b2a1eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.746009 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume 80f8feb0-5bbf-4857-8078-a818ff55caea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f8feb0-5bbf-4857-8078-a818ff55caea', 'volume_size': 1}
Aug 27 21:06:13.747014 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] creating volume 'volume-80f8feb0-5bbf-4857-8078-a818ff55caea' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:13.747892 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:13.912900 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:13.913270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:13.919076 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7614e75-e122-4dc6-af93-06191b2a1eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f8feb0-5bbf-4857-8078-a818ff55caea', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.930412 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef235ee3-0244-4b40-a7fb-ffdf9cf8bb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:13.960619 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-80f8feb0-5bbf-4857-8078-a818ff55caea (80f8feb0-5bbf-4857-8078-a818ff55caea): created successfully
Aug 27 21:06:13.966913 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef235ee3-0244-4b40-a7fb-ffdf9cf8bb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:13.987302 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Flow 'volume_create_manager' (6c2a8fd6-54c9-4d20-98cb-8980c75d591a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:14.004099 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7c6d161d-b082-4f15-8eb1-e51242eca655 tempest-TaggedBootDevicesTest_v242-1042837722 None] Created volume successfully.
Aug 27 21:06:14.327189 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:14.373686 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Flow 'volume_create_manager' (d16e7a1a-7a23-4d57-be70-d03c0fb3e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:14.391227 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdfcd89-b52e-42a4-bf75-74337a11f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.433827 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bdfcd89-b52e-42a4-bf75-74337a11f1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1983864666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=954fbcb2-8e60-468a-8fb4-ab2f508f825d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ebee97f90d4fafbcadeb4e8279c8f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:14Z,use_quota=True,user_id='5d8126f174f5424ebdcc1f062ffb9b69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.441724 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a19da7-061e-45c1-89aa-8256eef64aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.455316 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7a19da7-061e-45c1-89aa-8256eef64aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.476017 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b9e17-00af-493f-b8aa-5215cdb8bdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.486323 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe8b9e17-00af-493f-b8aa-5215cdb8bdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'volume_name': 'volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.498883 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ea4511-1376-4ea0-8575-8eebf497dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.503613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ea4511-1376-4ea0-8575-8eebf497dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.524056 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389d7873-43dc-4dc2-a1d1-4874b7612687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.525189 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume 954fbcb2-8e60-468a-8fb4-ab2f508f825d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'volume_size': 1}
Aug 27 21:06:14.526534 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] creating volume 'volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:14.528157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:14.735191 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:14.736255 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:14.740741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389d7873-43dc-4dc2-a1d1-4874b7612687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.751058 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5b0f10-9482-427d-8cee-1dac057cde2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:14.845093 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d (954fbcb2-8e60-468a-8fb4-ab2f508f825d): created successfully
Aug 27 21:06:14.850196 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5b0f10-9482-427d-8cee-1dac057cde2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:14.874428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Flow 'volume_create_manager' (d16e7a1a-7a23-4d57-be70-d03c0fb3e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:14.904133 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7f12637f-f37d-4fe2-9a96-ec541a67b4c6 tempest-ServerRescueNegativeTestJSON-904246104 None] Created volume successfully.
Aug 27 21:06:20.477033 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:20.576739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (18906873-3b7c-45ae-8fc1-36ce1da608b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:20.623905 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca48305-fb46-4b2e-8eba-4800d6791837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:20.700051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca48305-fb46-4b2e-8eba-4800d6791837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1692046408',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=04cc8e53-b5b2-4dff-aa72-0eed729491a0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e67733e7f2b48209b8ff1e41cc4a103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:20Z,use_quota=True,user_id='77d4663e91d24caa96d48022c917e33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:20.730926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f6d7ce-2476-4de5-8c9e-c3ecf78f5391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:20.751087 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f6d7ce-2476-4de5-8c9e-c3ecf78f5391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:20.769003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f5f733-2775-4ed3-8aa4-d1b90c0ef068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:20.788440 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63f5f733-2775-4ed3-8aa4-d1b90c0ef068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04cc8e53-b5b2-4dff-aa72-0eed729491a0', 'volume_name': 'volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:20.809393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c27b0d-0870-4175-b1df-f08fc4f0f96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:20.824144 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7c27b0d-0870-4175-b1df-f08fc4f0f96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:20.833796 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daefdc9-36fa-4e91-88e7-ed71d75fe03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:20.849155 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Volume 04cc8e53-b5b2-4dff-aa72-0eed729491a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0', 'volume_size': 1}
Aug 27 21:06:20.859459 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] creating volume 'volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:20.864844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:21.067080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:21.067873 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:21.073114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0daefdc9-36fa-4e91-88e7-ed71d75fe03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:21.086631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af6486a-313c-44b7-9b16-c7ee8fe31f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:21.116355 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Volume volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0 (04cc8e53-b5b2-4dff-aa72-0eed729491a0): created successfully
Aug 27 21:06:21.123974 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af6486a-313c-44b7-9b16-c7ee8fe31f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:21.135222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (18906873-3b7c-45ae-8fc1-36ce1da608b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:21.173816 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-231c0ef8-bfca-4ef3-9ea8-2c1463e4d427 tempest-VolumesListTestJSON-894401934 None] Created volume successfully.
Aug 27 21:06:22.943272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:23.036014 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (e6132210-da7f-4641-b43e-60153c436197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:23.065473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517c00b2-4c74-46d5-b2ac-6ef632832d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.126091 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (517c00b2-4c74-46d5-b2ac-6ef632832d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-859318706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=523d6c9b-f8cd-4c04-acea-0f56404940dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e67733e7f2b48209b8ff1e41cc4a103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:23Z,use_quota=True,user_id='77d4663e91d24caa96d48022c917e33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.155475 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29238c27-199f-4b83-8dd1-2d2a4220dcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.165022 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29238c27-199f-4b83-8dd1-2d2a4220dcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.170864 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e93305-4d7c-4424-8caa-3b33d44e2719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.175745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07e93305-4d7c-4424-8caa-3b33d44e2719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '523d6c9b-f8cd-4c04-acea-0f56404940dc', 'volume_name': 'volume-523d6c9b-f8cd-4c04-acea-0f56404940dc', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.188433 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b18954-1be8-4662-8cbe-d4e413c70b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.209643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b18954-1be8-4662-8cbe-d4e413c70b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.226238 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5394cc52-7ced-413b-a70e-096d17d5460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.230591 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Volume 523d6c9b-f8cd-4c04-acea-0f56404940dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-523d6c9b-f8cd-4c04-acea-0f56404940dc', 'volume_size': 1}
Aug 27 21:06:23.232664 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] creating volume 'volume-523d6c9b-f8cd-4c04-acea-0f56404940dc' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:23.234442 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:23.399755 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:23.400080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:23.408772 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5394cc52-7ced-413b-a70e-096d17d5460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-523d6c9b-f8cd-4c04-acea-0f56404940dc', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.419260 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b12fc1-f400-4c29-951c-a46b394927fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:23.492645 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Volume volume-523d6c9b-f8cd-4c04-acea-0f56404940dc (523d6c9b-f8cd-4c04-acea-0f56404940dc): created successfully
Aug 27 21:06:23.504311 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b12fc1-f400-4c29-951c-a46b394927fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:23.527416 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (e6132210-da7f-4641-b43e-60153c436197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:23.556994 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-556b34db-dac1-4142-acfe-2c54ac22d455 tempest-VolumesListTestJSON-894401934 None] Created volume successfully.
Aug 27 21:06:25.096897 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=59,cinder:DELETE=5,cinder:UPDATE=20,cinder:INSERT=16 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:25.122918 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:25.201678 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (dd211078-6f99-45e0-9805-72ae7a0856dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:25.209016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6de4a41-5ed3-467f-a2e2-94d6ee1a9fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.261839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6de4a41-5ed3-467f-a2e2-94d6ee1a9fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-870413984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ed522d2-a6cd-4705-bf94-d813c38202be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e67733e7f2b48209b8ff1e41cc4a103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:25Z,use_quota=True,user_id='77d4663e91d24caa96d48022c917e33d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.274278 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b47abb4-b37b-490b-9325-d7f466ba318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.284843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b47abb4-b37b-490b-9325-d7f466ba318d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.299138 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07389b1a-cde8-48ec-925a-d030e2be4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.306298 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07389b1a-cde8-48ec-925a-d030e2be4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed522d2-a6cd-4705-bf94-d813c38202be', 'volume_name': 'volume-7ed522d2-a6cd-4705-bf94-d813c38202be', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.328674 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d294a0f8-18e3-4289-b06d-36f7a6571e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.337135 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d294a0f8-18e3-4289-b06d-36f7a6571e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.353539 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ec81f2-3d8b-4377-8119-df2bc7ef9ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.354811 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Volume 7ed522d2-a6cd-4705-bf94-d813c38202be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed522d2-a6cd-4705-bf94-d813c38202be', 'volume_size': 1}
Aug 27 21:06:25.355291 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] creating volume 'volume-7ed522d2-a6cd-4705-bf94-d813c38202be' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:25.356076 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:25.573093 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:25.573847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:25.578358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ec81f2-3d8b-4377-8119-df2bc7ef9ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed522d2-a6cd-4705-bf94-d813c38202be', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.588155 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c7933a-224e-481f-8d74-460d219a41e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:25.613572 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Volume volume-7ed522d2-a6cd-4705-bf94-d813c38202be (7ed522d2-a6cd-4705-bf94-d813c38202be): created successfully
Aug 27 21:06:25.618922 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c7933a-224e-481f-8d74-460d219a41e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:25.628135 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Flow 'volume_create_manager' (dd211078-6f99-45e0-9805-72ae7a0856dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:25.657563 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b17f60aa-ac55-4546-af78-c8034b411275 tempest-VolumesListTestJSON-894401934 None] Created volume successfully.
Aug 27 21:06:33.027113 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Acquiring lock "cinder-7ed522d2-a6cd-4705-bf94-d813c38202be-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:33.041614 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Lock "cinder-7ed522d2-a6cd-4705-bf94-d813c38202be-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:33.242344 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:33.389530 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:06:33.389966 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Volume volume-7ed522d2-a6cd-4705-bf94-d813c38202be is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:33.402601 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] deleting rbd volume volume-7ed522d2-a6cd-4705-bf94-d813c38202be {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:06:34.013557 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=31,cinder:SELECT=59,cinder:DELETE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:34.111177 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Created reservations ['1cbd0097-44fb-4e47-af6f-6793d71cf0a7', 'e5bb33e4-ed9e-4da9-92d8-215943ec3346', '9865a6a7-c34d-4a32-8195-71ea153b37df', '989e69ee-def4-42c2-b754-c1d6309b9761'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:06:34.275182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:34.415513 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:34.495256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:34.512600 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Acquiring lock "cinder-523d6c9b-f8cd-4c04-acea-0f56404940dc-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:34.528638 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Deleted volume successfully.
Aug 27 21:06:34.558737 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Lock "cinder-523d6c9b-f8cd-4c04-acea-0f56404940dc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:34.606109 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ceb7d721-4c42-4a58-b46c-c06b3ce6d723 tempest-VolumesListTestJSON-894401934 None] Lock "cinder-7ed522d2-a6cd-4705-bf94-d813c38202be-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:34.683789 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:34.843434 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:06:34.843856 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Volume volume-523d6c9b-f8cd-4c04-acea-0f56404940dc is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:34.865261 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] deleting rbd volume volume-523d6c9b-f8cd-4c04-acea-0f56404940dc {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:06:35.453003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Created reservations ['9539478e-225c-47d1-9780-1adb8fb369e9', '197fce90-90d3-4b38-ae0c-5e8a97b23822', '662bb5c6-1ce7-4518-9033-00275c983d9d', '56e80783-291a-4831-89c2-8a14b8dce1aa'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:06:35.618231 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:35.685767 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:35.772918 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:35.777286 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Deleted volume successfully.
Aug 27 21:06:35.806665 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6a9750ce-006f-41c9-a5b8-be8a5d0317bf tempest-VolumesListTestJSON-894401934 None] Lock "cinder-523d6c9b-f8cd-4c04-acea-0f56404940dc-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:36.788960 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Acquiring lock "cinder-04cc8e53-b5b2-4dff-aa72-0eed729491a0-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:36.802137 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Lock "cinder-04cc8e53-b5b2-4dff-aa72-0eed729491a0-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:36.898231 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:37.004627 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:06:37.005294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Volume volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:37.018734 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] deleting rbd volume volume-04cc8e53-b5b2-4dff-aa72-0eed729491a0 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:06:37.683272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Created reservations ['d7bb77c7-8a6b-4a70-abe3-34b2d47bca66', '3c88f8f1-7166-4438-9c8d-e5298c006800', 'f03a3cda-73a2-4f2e-a1cb-e8dcf6bd44e0', 'da295e71-b0f7-41b9-85b6-0d2a7d192032'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:06:37.803855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:37.875162 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:37.949576 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:06:37.955499 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Deleted volume successfully.
Aug 27 21:06:38.023774 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-dc699ce0-532c-4716-adf9-2b3fcb8287b9 tempest-VolumesListTestJSON-894401934 None] Lock "cinder-04cc8e53-b5b2-4dff-aa72-0eed729491a0-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:44.654034 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:44.740831 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (9e204518-c78f-47c1-b8a6-fe5f58f644dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:44.775976 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f9057e-8ad8-4351-bcbd-db217acb83db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:44.887833 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f9057e-8ad8-4351-bcbd-db217acb83db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1382086513',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ff8fefeb-4f39-4b64-911f-d2ce862755c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366653ab581f4c23aa632fe3253100cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:44Z,use_quota=True,user_id='c82ae6511f2443888af3d79a6a40d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:44.966080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d58f2-90ee-46f7-835b-47329314ab38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:45.004276 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64d58f2-90ee-46f7-835b-47329314ab38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:45.030350 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5312f6-45c3-444e-92d5-4daac3f2757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:45.216497 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc5312f6-45c3-444e-92d5-4daac3f2757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'volume_name': 'volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac614c10>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:45.221450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f783045f-3761-408f-b13e-eb570484be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:45.240975 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f783045f-3761-408f-b13e-eb570484be2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:45.249745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e59e70-d7e0-4019-a1a0-647a5a734c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:45.267672 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Volume ff8fefeb-4f39-4b64-911f-d2ce862755c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac614c10>}
Aug 27 21:06:45.268370 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Cloning ff8fefeb-4f39-4b64-911f-d2ce862755c0 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:06:45.269226 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:06:45.292569 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:06:45.324450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 6, 45, 300369)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:06:45.324867 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:06:45.325256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:06:45.332754 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.041s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:06:45.334079 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:06:45.385222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 6, 45, 361359)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:06:45.386505 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:06:45.389296 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:06:45.434655 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:45.583613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] creating snapshot='volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:06:46.650026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0.clone_snap' to 'volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:06:46.901671 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:06:46.904746 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:46.905303 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:46.967030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:06:46.967880 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Marking volume ff8fefeb-4f39-4b64-911f-d2ce862755c0 as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:06:46.981120 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to ff8fefeb-4f39-4b64-911f-d2ce862755c0. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:06:46.981528 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Creating volume glance metadata for volume ff8fefeb-4f39-4b64-911f-d2ce862755c0 backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:06:47.093093 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25e59e70-d7e0-4019-a1a0-647a5a734c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac614c10>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:47.108025 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8627c7-4cbf-4e4c-90d3-1a6c446fc2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:47.112862 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=46,cinder:INSERT=13,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:47.131814 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Volume volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0 (ff8fefeb-4f39-4b64-911f-d2ce862755c0): created successfully
Aug 27 21:06:47.135447 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8627c7-4cbf-4e4c-90d3-1a6c446fc2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:47.141052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (9e204518-c78f-47c1-b8a6-fe5f58f644dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:47.181635 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-94bf9256-842b-4f38-842e-04910e85d150 tempest-TaggedBootDevicesTest-326852622 None] Created volume successfully.
Aug 27 21:06:48.470408 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:48.519488 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (fadffaad-4159-44bf-9b63-cbca0751ba2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:48.538348 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3981dc0-5f50-4029-adbb-65a9dbc7f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.595086 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3981dc0-5f50-4029-adbb-65a9dbc7f58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-780106288',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=31351cef-5982-4d71-9c5e-aa314e882454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366653ab581f4c23aa632fe3253100cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:48Z,use_quota=True,user_id='c82ae6511f2443888af3d79a6a40d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.644034 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a34d1e4-9b7b-4bbc-9b19-ea14599fa48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.651898 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a34d1e4-9b7b-4bbc-9b19-ea14599fa48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.689314 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b7289-f516-4de7-ae35-1f24e172cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.723439 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1b7289-f516-4de7-ae35-1f24e172cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31351cef-5982-4d71-9c5e-aa314e882454', 'volume_name': 'volume-31351cef-5982-4d71-9c5e-aa314e882454', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.734344 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7536c020-2bd6-421f-b268-0cbf25ab4588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.744529 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7536c020-2bd6-421f-b268-0cbf25ab4588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.749689 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266608ae-4980-4ecc-b0d7-c2ad446263e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.751231 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Volume 31351cef-5982-4d71-9c5e-aa314e882454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31351cef-5982-4d71-9c5e-aa314e882454', 'volume_size': 1}
Aug 27 21:06:48.751952 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] creating volume 'volume-31351cef-5982-4d71-9c5e-aa314e882454' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:48.752929 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:48.906828 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:48.908773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:48.917149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (266608ae-4980-4ecc-b0d7-c2ad446263e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31351cef-5982-4d71-9c5e-aa314e882454', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.922361 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3610c97-1195-4434-b6c3-fc4ffc5e34c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:48.952211 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Volume volume-31351cef-5982-4d71-9c5e-aa314e882454 (31351cef-5982-4d71-9c5e-aa314e882454): created successfully
Aug 27 21:06:48.959505 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3610c97-1195-4434-b6c3-fc4ffc5e34c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:48.977147 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (fadffaad-4159-44bf-9b63-cbca0751ba2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:48.993301 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8fbd9d68-2cba-4412-8d21-cb67e55c089b tempest-TaggedBootDevicesTest-326852622 None] Created volume successfully.
Aug 27 21:06:50.166056 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:06:50.202284 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (9652dcef-4b2e-46f5-8e19-c9f0a230463d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:50.210075 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53545e4-f3a5-4a20-bbf0-a1c5f0055784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.265603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53545e4-f3a5-4a20-bbf0-a1c5f0055784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-639852289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a8c2b98b-2f95-421a-96ce-82bbd3cabd81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='366653ab581f4c23aa632fe3253100cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:06:50Z,use_quota=True,user_id='c82ae6511f2443888af3d79a6a40d7d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.277973 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1681d2e6-c70f-432d-9c52-c7605f810b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.282928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1681d2e6-c70f-432d-9c52-c7605f810b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.290646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0d8f7f-91c5-4a3e-a440-430a7703b8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.296427 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0d8f7f-91c5-4a3e-a440-430a7703b8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'volume_name': 'volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.302277 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3293e306-a55b-4053-aac3-f55fef77d379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.320714 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3293e306-a55b-4053-aac3-f55fef77d379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.327000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212ada41-e7a6-458f-bba8-03d88987b5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.328474 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Volume a8c2b98b-2f95-421a-96ce-82bbd3cabd81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'volume_size': 1}
Aug 27 21:06:50.329099 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] creating volume 'volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:06:50.330508 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:06:50.478840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:06:50.479225 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:06:50.483498 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (212ada41-e7a6-458f-bba8-03d88987b5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.490357 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c942c21-48fa-43da-9665-765025a0773e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:06:50.516197 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Volume volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81 (a8c2b98b-2f95-421a-96ce-82bbd3cabd81): created successfully
Aug 27 21:06:50.520457 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c942c21-48fa-43da-9665-765025a0773e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:06:50.531648 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Flow 'volume_create_manager' (9652dcef-4b2e-46f5-8e19-c9f0a230463d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:06:50.536163 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=65,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=11 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:06:50.547353 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-da8e7214-9425-479f-b1d6-e0fca4b4f25a tempest-TaggedBootDevicesTest-326852622 None] Created volume successfully.
Aug 27 21:06:56.890701 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-1fbb9575-5ab0-4937-b75d-057833b67ea0 tempest-TaggedBootDevicesTest_v242-1042837722 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:06:58.393202 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-1fbb9575-5ab0-4937-b75d-057833b67ea0 tempest-TaggedBootDevicesTest_v242-1042837722 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.504s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:06:58.394033 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-1fbb9575-5ab0-4937-b75d-057833b67ea0 tempest-TaggedBootDevicesTest_v242-1042837722 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:06:58.453201 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-1fbb9575-5ab0-4937-b75d-057833b67ea0 tempest-TaggedBootDevicesTest_v242-1042837722 None] Connection info returned from driver {'name': 'volumes/volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4e2488ca-6bf7-4eec-90ad-0aee15955f29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e6e2d1f0-10dc-40c5-b775-613e69e60fe5'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:06:58.534324 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-1fbb9575-5ab0-4937-b75d-057833b67ea0 tempest-TaggedBootDevicesTest_v242-1042837722 None] attachment_update completed successfully.
Aug 27 21:06:59.105787 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-7ba5babd-2197-4ec7-a61c-783c0d4354eb tempest-TaggedBootDevicesTest_v242-1042837722 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:07:00.457935 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-7ba5babd-2197-4ec7-a61c-783c0d4354eb tempest-TaggedBootDevicesTest_v242-1042837722 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.352s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:07:00.459744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-7ba5babd-2197-4ec7-a61c-783c0d4354eb tempest-TaggedBootDevicesTest_v242-1042837722 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7bb09a2e-9d97-407e-a8bf-817e7b438724', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '7bb09a2e-9d97-407e-a8bf-817e7b438724', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:07:00.492439 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-7ba5babd-2197-4ec7-a61c-783c0d4354eb tempest-TaggedBootDevicesTest_v242-1042837722 None] Connection info returned from driver {'name': 'volumes/volume-7bb09a2e-9d97-407e-a8bf-817e7b438724', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7bb09a2e-9d97-407e-a8bf-817e7b438724', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'bef9e7c1-076d-42d6-850c-1b63d249f538'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:07:00.591219 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-7ba5babd-2197-4ec7-a61c-783c0d4354eb tempest-TaggedBootDevicesTest_v242-1042837722 None] attachment_update completed successfully.
Aug 27 21:07:01.053797 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-12be1202-f124-4757-96fe-6f8155043af2 tempest-TaggedBootDevicesTest_v242-1042837722 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:07:02.452838 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-12be1202-f124-4757-96fe-6f8155043af2 tempest-TaggedBootDevicesTest_v242-1042837722 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.397s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:07:02.453738 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-12be1202-f124-4757-96fe-6f8155043af2 tempest-TaggedBootDevicesTest_v242-1042837722 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-80f8feb0-5bbf-4857-8078-a818ff55caea', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '80f8feb0-5bbf-4857-8078-a818ff55caea', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:07:02.498628 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-12be1202-f124-4757-96fe-6f8155043af2 tempest-TaggedBootDevicesTest_v242-1042837722 None] Connection info returned from driver {'name': 'volumes/volume-80f8feb0-5bbf-4857-8078-a818ff55caea', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '80f8feb0-5bbf-4857-8078-a818ff55caea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ff9c990a-f1fe-4cb4-9912-7c43babc1e7e'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:07:02.634515 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-947ac93e-01e0-447e-a7d4-1bc9745f7747 req-12be1202-f124-4757-96fe-6f8155043af2 tempest-TaggedBootDevicesTest_v242-1042837722 None] attachment_update completed successfully.
Aug 27 21:07:02.856551 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:07:02.858422 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:07:02.931509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:07:03.019737 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:07:21.028313 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:DELETE=2,cinder:SELECT=47,cinder:UPDATE=10 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:07:21.028960 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=36,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:07:22.616672 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-8e605166-37b2-4503-ad0e-466b373a70a6 tempest-TaggedBootDevicesTest-326852622 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:07:24.688163 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-8e605166-37b2-4503-ad0e-466b373a70a6 tempest-TaggedBootDevicesTest-326852622 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.071s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:07:24.689319 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-8e605166-37b2-4503-ad0e-466b373a70a6 tempest-TaggedBootDevicesTest-326852622 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:07:24.759890 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-8e605166-37b2-4503-ad0e-466b373a70a6 tempest-TaggedBootDevicesTest-326852622 None] Connection info returned from driver {'name': 'volumes/volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ff8fefeb-4f39-4b64-911f-d2ce862755c0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '2bb66f35-2f83-41cb-9f3e-a5357940f4eb'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:07:24.902267 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-8e605166-37b2-4503-ad0e-466b373a70a6 tempest-TaggedBootDevicesTest-326852622 None] attachment_update completed successfully.
Aug 27 21:07:25.769028 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-7ac53c8e-45b3-45af-96ad-58a2feb4bac7 tempest-TaggedBootDevicesTest-326852622 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:07:27.494363 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-7ac53c8e-45b3-45af-96ad-58a2feb4bac7 tempest-TaggedBootDevicesTest-326852622 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.730s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:07:27.495182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-7ac53c8e-45b3-45af-96ad-58a2feb4bac7 tempest-TaggedBootDevicesTest-326852622 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-31351cef-5982-4d71-9c5e-aa314e882454', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '31351cef-5982-4d71-9c5e-aa314e882454', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:07:27.552829 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-7ac53c8e-45b3-45af-96ad-58a2feb4bac7 tempest-TaggedBootDevicesTest-326852622 None] Connection info returned from driver {'name': 'volumes/volume-31351cef-5982-4d71-9c5e-aa314e882454', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '31351cef-5982-4d71-9c5e-aa314e882454', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0114858d-1e30-441c-a5df-dfaf11fb644e'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:07:27.712213 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-7ac53c8e-45b3-45af-96ad-58a2feb4bac7 tempest-TaggedBootDevicesTest-326852622 None] attachment_update completed successfully.
Aug 27 21:07:28.284332 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-466cd7a8-d350-4b87-9349-b172fc1eec99 tempest-TaggedBootDevicesTest-326852622 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:07:29.724898 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-466cd7a8-d350-4b87-9349-b172fc1eec99 tempest-TaggedBootDevicesTest-326852622 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.437s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:07:29.727390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-466cd7a8-d350-4b87-9349-b172fc1eec99 tempest-TaggedBootDevicesTest-326852622 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:07:29.791580 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-466cd7a8-d350-4b87-9349-b172fc1eec99 tempest-TaggedBootDevicesTest-326852622 None] Connection info returned from driver {'name': 'volumes/volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a8c2b98b-2f95-421a-96ce-82bbd3cabd81', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '78bd1bdc-39be-45bb-a8f7-c2d4bdac7b68'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:07:29.894019 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-bdd0bb4a-802a-4963-8a8e-3f79e2757df3 req-466cd7a8-d350-4b87-9349-b172fc1eec99 tempest-TaggedBootDevicesTest-326852622 None] attachment_update completed successfully.
Aug 27 21:07:41.031545 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=35,cinder:UPDATE=7 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:01.030561 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=39,cinder:UPDATE=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:02.857439 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:08:02.858214 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:02.886471 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:02.914961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:08:06.550289 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc req-57a7b288-13f0-49c9-b40c-d08814c11f7b tempest-AttachVolumeNegativeTest-737699077 None] Terminate volume connection completed successfully.
Aug 27 21:08:06.551358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-d000b81e-0046-4e85-b7fc-4c4f070cb4fc req-57a7b288-13f0-49c9-b40c-d08814c11f7b tempest-AttachVolumeNegativeTest-737699077 None] Deleting attachment 07585c5a-82d4-46c6-951c-03c58eafd285. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:08:10.772672 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-14c5a6b2-32ce-4b4c-9a50-186751457bdc req-01c49515-bfc0-4415-b193-0d9b61d46f68 tempest-ServerRescueNegativeTestJSON-904246104 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:08:11.922171 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-14c5a6b2-32ce-4b4c-9a50-186751457bdc req-01c49515-bfc0-4415-b193-0d9b61d46f68 tempest-ServerRescueNegativeTestJSON-904246104 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.149s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:08:11.930041 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-14c5a6b2-32ce-4b4c-9a50-186751457bdc req-01c49515-bfc0-4415-b193-0d9b61d46f68 tempest-ServerRescueNegativeTestJSON-904246104 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:08:12.003798 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-14c5a6b2-32ce-4b4c-9a50-186751457bdc req-01c49515-bfc0-4415-b193-0d9b61d46f68 tempest-ServerRescueNegativeTestJSON-904246104 None] Connection info returned from driver {'name': 'volumes/volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '954fbcb2-8e60-468a-8fb4-ab2f508f825d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '47ca9ef7-27f5-4f1e-83ee-09ec259c4f40'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:08:12.179809 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-14c5a6b2-32ce-4b4c-9a50-186751457bdc req-01c49515-bfc0-4415-b193-0d9b61d46f68 tempest-ServerRescueNegativeTestJSON-904246104 None] attachment_update completed successfully.
Aug 27 21:08:20.867137 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Acquiring lock "cinder-8b676fbc-affb-4ef6-83b6-7851850043bf-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:08:20.887665 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Lock "cinder-8b676fbc-affb-4ef6-83b6-7851850043bf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:08:20.942088 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:20.996654 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:08:20.997120 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Volume volume-8b676fbc-affb-4ef6-83b6-7851850043bf is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:08:21.012446 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] deleting rbd volume volume-8b676fbc-affb-4ef6-83b6-7851850043bf {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:08:21.161452 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=27,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:21.195158 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Created reservations ['139c6552-2098-4165-86e6-6313ee4f48fb', '464fb164-44cd-4438-90fa-9e5cd44e8d44', 'a7979eca-8773-4e05-88ca-cf6a736bc6d4', 'f8d68951-ec90-46bc-9959-7896b513661a'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:21.267964 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:21.345370 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:21.403110 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:08:21.410919 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Deleted volume successfully.
Aug 27 21:08:21.461914 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7be5717c-1092-4c65-8098-a0e13f90d75d tempest-GroupSnapshotsV319Test-904813750 None] Group tempest-GroupSnapshotsV319Test-Group-341849062: creating
Aug 27 21:08:21.497004 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7f214b90-ef7f-4438-8f1d-ed26165cecea tempest-DeleteServersTestJSON-1482281639 None] Lock "cinder-8b676fbc-affb-4ef6-83b6-7851850043bf-delete_volume" released by "delete_volume" :: held 0.610s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:08:21.536611 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7be5717c-1092-4c65-8098-a0e13f90d75d tempest-GroupSnapshotsV319Test-904813750 None] Group tempest-GroupSnapshotsV319Test-Group-341849062: created successfully
Aug 27 21:08:21.550991 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7be5717c-1092-4c65-8098-a0e13f90d75d tempest-GroupSnapshotsV319Test-904813750 None] Create group completed successfully.
Aug 27 21:08:23.039243 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:08:23.059098 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Flow 'volume_create_manager' (de8d4319-0850-40cd-99b3-ee6b94f117fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:23.066866 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf55e510-a42d-4162-a523-3fc25a48b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.086790 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf55e510-a42d-4162-a523-3fc25a48b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-492931182',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5bd25591-b288-4710-b57f-034f8a99e6c7,host='ncdv-master-1@ceph#ceph',id=be963416-2616-437a-b12c-dc8fc2f93287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08507977c31842509c31ee019c15305d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:08:23Z,use_quota=True,user_id='542fd920ae5441888519f3a23e889fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12f8ec8c-cc10-46e9-8df9-ab08b7c49ddb),volume_type_id=12f8ec8c-cc10-46e9-8df9-ab08b7c49ddb)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.092519 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45558f4e-17c4-4248-b475-b0b8c74c207e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.096881 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45558f4e-17c4-4248-b475-b0b8c74c207e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.102856 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bcfe22-3e50-45cc-807b-18422f9507b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.106866 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1bcfe22-3e50-45cc-807b-18422f9507b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be963416-2616-437a-b12c-dc8fc2f93287', 'volume_name': 'volume-be963416-2616-437a-b12c-dc8fc2f93287', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.111674 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715ff6eb-9bc3-41a7-a0d3-ad38cbec95fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.115744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715ff6eb-9bc3-41a7-a0d3-ad38cbec95fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.120296 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac1935-9487-4239-b9f1-01fe6b293c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.121615 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Volume be963416-2616-437a-b12c-dc8fc2f93287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be963416-2616-437a-b12c-dc8fc2f93287', 'volume_size': 1}
Aug 27 21:08:23.122013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] creating volume 'volume-be963416-2616-437a-b12c-dc8fc2f93287' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:08:23.122821 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:23.205606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:08:23.206378 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:08:23.212784 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aac1935-9487-4239-b9f1-01fe6b293c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be963416-2616-437a-b12c-dc8fc2f93287', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.218735 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43472dcc-28e8-4c7f-8995-ee77333e1ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:23.234043 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Volume volume-be963416-2616-437a-b12c-dc8fc2f93287 (be963416-2616-437a-b12c-dc8fc2f93287): created successfully
Aug 27 21:08:23.239814 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43472dcc-28e8-4c7f-8995-ee77333e1ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:23.246762 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Flow 'volume_create_manager' (de8d4319-0850-40cd-99b3-ee6b94f117fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:23.260549 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a2601f74-d977-4e25-b5d8-44fcf2f2ded7 tempest-GroupSnapshotsV319Test-904813750 None] Created volume successfully.
Aug 27 21:08:24.457246 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a99ee4e4-ebff-4c92-840e-38c465406a0b tempest-GroupSnapshotsV319Test-904813750 None] GroupSnapshot 9943974b-8aaf-42da-b8e2-41a572935824: creating.
Aug 27 21:08:24.517687 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a99ee4e4-ebff-4c92-840e-38c465406a0b tempest-GroupSnapshotsV319Test-904813750 None] Group snapshot 9943974b-8aaf-42da-b8e2-41a572935824: creating. {{(pid=133391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Aug 27 21:08:24.537545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a99ee4e4-ebff-4c92-840e-38c465406a0b tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:25.411458 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a99ee4e4-ebff-4c92-840e-38c465406a0b tempest-GroupSnapshotsV319Test-904813750 None] group_snapshot 9943974b-8aaf-42da-b8e2-41a572935824: created successfully
Aug 27 21:08:26.137154 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] group_snapshot 9943974b-8aaf-42da-b8e2-41a572935824: deleting
Aug 27 21:08:26.168175 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] group_snapshot 9943974b-8aaf-42da-b8e2-41a572935824: deleting {{(pid=133391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Aug 27 21:08:26.198745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:27.448726 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974851459 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-974851459, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:08:27.449747 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-974851459 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-974851459, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:08:27.471943 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] Created reservations ['ba5355aa-87bb-4ff3-8644-eb1c99f6cd10', '8f70352f-0f24-44a4-9b4a-44aee28d87d9', '6d7f7fec-3dee-4f99-b31c-d817488d4397', '8f810c43-9d75-47b0-b8fc-12daa8ea0cdb'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:27.556964 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7203e795-967c-454a-8dea-1e13386a0b73 tempest-GroupSnapshotsV319Test-904813750 None] group_snapshot 9943974b-8aaf-42da-b8e2-41a572935824: deleted successfully
Aug 27 21:08:28.832738 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:28.912626 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:08:28.913147 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Volume volume-be963416-2616-437a-b12c-dc8fc2f93287 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:08:28.920162 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] deleting rbd volume volume-be963416-2616-437a-b12c-dc8fc2f93287 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:08:29.156683 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Created reservations ['1ad9c209-12e2-4b8b-bfb9-7b0723df0d99'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:29.178503 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-974851459 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-974851459, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:08:29.219811 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Created reservations ['96456eb1-e1a1-46c3-a10f-2ce91f21bf75', '607af8b0-0caa-4965-84a5-d2cc64b2eed8', '02c0a026-7e0e-4b56-8568-c3b302bd6377', '5bde6564-0b5b-45ed-b506-ef2218ec85c7'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:29.262072 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=74,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:29.296362 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=56,cinder:INSERT=9,cinder:UPDATE=34,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:29.348305 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:29.423236 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:29.510685 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:08:29.515786 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-75052bc5-4bae-4edb-9e04-fd6f8270061a tempest-GroupSnapshotsV319Test-904813750 None] Delete group completed successfully.
Aug 27 21:08:41.041016 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:08:47.924326 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:08:47.944318 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Flow 'volume_create_manager' (c7357396-f769-49a6-9206-687e8f950b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:47.950781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64583112-465d-477e-858d-736a6e7df35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:47.969071 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64583112-465d-477e-858d-736a6e7df35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-854276207',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3043c10-cefb-49c4-8ae4-db76065a3cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe85f9df8134af0839b6df29a74b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:08:48Z,use_quota=True,user_id='c92597a65bf444738e0c64546b9583a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:47.974521 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952664a-794e-4aac-b468-148ef73783af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:47.978633 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f952664a-794e-4aac-b468-148ef73783af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:47.983854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4e49aa-21b4-4909-b954-3dd85fa890af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:47.988114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4e49aa-21b4-4909-b954-3dd85fa890af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3043c10-cefb-49c4-8ae4-db76065a3cdb', 'volume_name': 'volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:47.992941 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73c77b3-932e-4468-87b4-5435abc4762a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:47.996786 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73c77b3-932e-4468-87b4-5435abc4762a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:48.001429 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7868e5a3-b3f6-4050-807d-940ac65606fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:48.002811 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Volume d3043c10-cefb-49c4-8ae4-db76065a3cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb', 'volume_size': 1}
Aug 27 21:08:48.003214 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] creating volume 'volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:08:48.004020 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:48.067854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:08:48.068607 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:08:48.073908 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7868e5a3-b3f6-4050-807d-940ac65606fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:48.079286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc9436-9d5a-4809-b9a5-cc277744f8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:48.088757 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Volume volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb (d3043c10-cefb-49c4-8ae4-db76065a3cdb): created successfully
Aug 27 21:08:48.092596 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bcc9436-9d5a-4809-b9a5-cc277744f8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:48.102024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Flow 'volume_create_manager' (c7357396-f769-49a6-9206-687e8f950b22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:48.112037 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-99669d9e-703e-4a09-96c4-5ab5af2f25c3 tempest-VolumesTransfersV355Test-1776176715 None] Created volume successfully.
Aug 27 21:08:49.592423 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-488da3a9-006c-4eeb-9132-297c0a3eaa41 tempest-VolumesTransfersV355Test-1649636892 None] Transfer volume completed successfully.
Aug 27 21:08:49.990618 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Acquiring lock "cinder-d3043c10-cefb-49c4-8ae4-db76065a3cdb-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:08:50.000263 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Lock "cinder-d3043c10-cefb-49c4-8ae4-db76065a3cdb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:08:50.030623 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:50.078629 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:08:50.079159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Volume volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:08:50.083390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] deleting rbd volume volume-d3043c10-cefb-49c4-8ae4-db76065a3cdb {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:08:50.271753 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Created reservations ['56199aa5-175c-48e9-a932-15d4c4d87fb4', '13386027-a342-4a54-9428-4e444860ccf4', 'ab06e339-7d3c-433d-8f99-03b3b728094c', 'de1ff0d7-bb96-4f8c-a062-5e794ad6da93'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:50.320991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:50.347787 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:50.378913 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:08:50.384462 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Deleted volume successfully.
Aug 27 21:08:50.399768 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8a8f5813-ac39-4dd5-afba-c00752a79cd4 tempest-VolumesTransfersV355Test-1509417797 None] Lock "cinder-d3043c10-cefb-49c4-8ae4-db76065a3cdb-delete_volume" released by "delete_volume" :: held 0.399s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:08:51.470571 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:08:51.491469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Flow 'volume_create_manager' (f6813e2c-bfa2-4495-bc71-b4d8538a767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:51.497854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b278ce1f-50e7-4f60-9a7b-e53a00f7f214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.517466 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b278ce1f-50e7-4f60-9a7b-e53a00f7f214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1953177875',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b73c646-858c-4e4f-ad99-e2ecd8ec92bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe85f9df8134af0839b6df29a74b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:08:51Z,use_quota=True,user_id='c92597a65bf444738e0c64546b9583a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.523678 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e80915-817e-4075-8cc8-d7299ed1a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.528249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0e80915-817e-4075-8cc8-d7299ed1a262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.533421 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ca1047-b813-42f6-9cee-f9e25939e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.537665 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ca1047-b813-42f6-9cee-f9e25939e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b73c646-858c-4e4f-ad99-e2ecd8ec92bd', 'volume_name': 'volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.543147 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a04bfa4-728d-414c-8246-f6ce078d7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.547502 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a04bfa4-728d-414c-8246-f6ce078d7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.552465 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e9ef86-3564-4345-8e6d-01610ffefd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.553583 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Volume 8b73c646-858c-4e4f-ad99-e2ecd8ec92bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd', 'volume_size': 1}
Aug 27 21:08:51.554001 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] creating volume 'volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:08:51.554832 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:51.620222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:08:51.620596 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:08:51.624598 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e9ef86-3564-4345-8e6d-01610ffefd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.630038 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b7a45-1d0b-421c-b692-41020c9115be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:51.641869 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Volume volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd (8b73c646-858c-4e4f-ad99-e2ecd8ec92bd): created successfully
Aug 27 21:08:51.646000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149b7a45-1d0b-421c-b692-41020c9115be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:51.651563 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Flow 'volume_create_manager' (f6813e2c-bfa2-4495-bc71-b4d8538a767c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:51.661223 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0ea615ef-6172-4bc0-ab34-f05740cf4dd8 tempest-VolumesTransfersV355Test-1776176715 None] Created volume successfully.
Aug 27 21:08:52.778865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Acquiring lock "cinder-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:08:52.790348 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Lock "cinder-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:08:52.827300 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:52.867584 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:08:52.868259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Volume volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:08:52.876323 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] deleting rbd volume volume-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:08:53.072506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Created reservations ['fc416762-eacb-4965-b166-aead5354fa1d', 'fd0616ee-e159-49b2-966b-d7b6c305d53b', '75d681b6-ca1f-4dea-911b-6ce00b27e9d1', '0e3baae3-7a6f-40c4-9fe5-1869402c75f0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:08:53.125446 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:53.171417 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:53.218370 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:08:53.225025 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Deleted volume successfully.
Aug 27 21:08:53.243688 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e6f960f8-a0f2-4c40-8489-5112da3b9699 tempest-VolumesTransfersV355Test-1509417797 None] Lock "cinder-8b73c646-858c-4e4f-ad99-e2ecd8ec92bd-delete_volume" released by "delete_volume" :: held 0.453s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:08:58.700775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:08:58.731909 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Flow 'volume_create_manager' (554d3b10-4d4e-4e8a-862c-83e82ba7ce9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:58.738859 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fe0100-486f-474a-a688-663289602adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.758672 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fe0100-486f-474a-a688-663289602adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1040337663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4343cc59-8a25-4226-bcf3-d0780e045c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0224e49310e4b1ca2e9c8aa7999dda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:08:59Z,use_quota=True,user_id='eaf9744f89fe4df9a10e9cb0297cc7d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.765296 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b609b996-4761-4f00-8848-c67c7d12a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.769876 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b609b996-4761-4f00-8848-c67c7d12a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.775467 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3446b9ce-3cfa-4d82-8134-8bccb3547bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.779610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3446b9ce-3cfa-4d82-8134-8bccb3547bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4343cc59-8a25-4226-bcf3-d0780e045c66', 'volume_name': 'volume-4343cc59-8a25-4226-bcf3-d0780e045c66', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.784864 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103cb084-1b00-4843-8ba0-25da4755b91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.793739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103cb084-1b00-4843-8ba0-25da4755b91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.799045 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daa4cf4-d5ec-4493-8bac-df0cf8c1549e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.800319 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Volume 4343cc59-8a25-4226-bcf3-d0780e045c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4343cc59-8a25-4226-bcf3-d0780e045c66', 'volume_size': 1}
Aug 27 21:08:58.800917 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] creating volume 'volume-4343cc59-8a25-4226-bcf3-d0780e045c66' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:08:58.810319 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:08:58.892325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:08:58.892861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:08:58.897471 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9daa4cf4-d5ec-4493-8bac-df0cf8c1549e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4343cc59-8a25-4226-bcf3-d0780e045c66', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.902306 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c502bc-3654-4c4e-9062-81281b0369bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:08:58.911924 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Volume volume-4343cc59-8a25-4226-bcf3-d0780e045c66 (4343cc59-8a25-4226-bcf3-d0780e045c66): created successfully
Aug 27 21:08:58.915694 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21c502bc-3654-4c4e-9062-81281b0369bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:08:58.921148 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Flow 'volume_create_manager' (554d3b10-4d4e-4e8a-862c-83e82ba7ce9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:08:58.932892 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-85285774-1335-46d2-a5d7-782d8534759b tempest-VolumesActionsTest-65705369 None] Created volume successfully.
Aug 27 21:09:01.039383 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=29,cinder:SELECT=42,cinder:DELETE=3,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:09:02.864312 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:09:02.865798 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:02.914914 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:02.979926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:09:15.690757 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9a986729-b32a-4921-b7e7-1910e60fbbe0 tempest-VolumesActionsTest-65705369 None] Acquiring lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" by "attach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:15.705115 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9a986729-b32a-4921-b7e7-1910e60fbbe0 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" acquired by "attach_volume" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:15.707915 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=42,cinder:UPDATE=20,cinder:INSERT=3,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:09:15.761892 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9a986729-b32a-4921-b7e7-1910e60fbbe0 tempest-VolumesActionsTest-65705369 None] Attaching volume 4343cc59-8a25-4226-bcf3-d0780e045c66 to instance e89cddf5-c020-47f1-851d-7cacfec789fe at mountpoint /dev/sdb on host None.
Aug 27 21:09:15.794418 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9a986729-b32a-4921-b7e7-1910e60fbbe0 tempest-VolumesActionsTest-65705369 None] Attach volume completed successfully.
Aug 27 21:09:15.801336 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9a986729-b32a-4921-b7e7-1910e60fbbe0 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" released by "attach_volume" :: held 0.097s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:15.955872 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e93280fd-cb84-40a0-a9fa-c844d9dc3317 tempest-VolumesActionsTest-65705369 None] Acquiring lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" by "detach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:15.973635 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e93280fd-cb84-40a0-a9fa-c844d9dc3317 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:15.974132 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e93280fd-cb84-40a0-a9fa-c844d9dc3317 tempest-VolumesActionsTest-65705369 None] Detaching volume 4343cc59-8a25-4226-bcf3-d0780e045c66 from instance e89cddf5-c020-47f1-851d-7cacfec789fe.
Aug 27 21:09:16.037520 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e93280fd-cb84-40a0-a9fa-c844d9dc3317 tempest-VolumesActionsTest-65705369 None] Detach volume completed successfully.
Aug 27 21:09:16.043228 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e93280fd-cb84-40a0-a9fa-c844d9dc3317 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:31.035430 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=18,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:09:41.341981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ca31653b-eb36-4db2-8bbe-d8ce2cdef6c8 tempest-VolumesActionsTest-65705369 None] Acquiring lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" by "attach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:41.351246 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ca31653b-eb36-4db2-8bbe-d8ce2cdef6c8 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" acquired by "attach_volume" :: waited 0.009s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:41.390664 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca31653b-eb36-4db2-8bbe-d8ce2cdef6c8 tempest-VolumesActionsTest-65705369 None] Attaching volume 4343cc59-8a25-4226-bcf3-d0780e045c66 to instance 1b08530a-8e21-414c-8ad0-49c21743bc07 at mountpoint /dev/sdb on host None.
Aug 27 21:09:41.417292 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca31653b-eb36-4db2-8bbe-d8ce2cdef6c8 tempest-VolumesActionsTest-65705369 None] Attach volume completed successfully.
Aug 27 21:09:41.422500 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ca31653b-eb36-4db2-8bbe-d8ce2cdef6c8 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66" released by "attach_volume" :: held 0.071s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:41.600609 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e7ec38cd-b15b-4080-8dfb-3d03e25fb3d7 tempest-VolumesActionsTest-65705369 None] Acquiring lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" by "detach_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:41.611858 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e7ec38cd-b15b-4080-8dfb-3d03e25fb3d7 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:41.612343 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e7ec38cd-b15b-4080-8dfb-3d03e25fb3d7 tempest-VolumesActionsTest-65705369 None] Detaching volume 4343cc59-8a25-4226-bcf3-d0780e045c66 from instance 1b08530a-8e21-414c-8ad0-49c21743bc07.
Aug 27 21:09:41.650985 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e7ec38cd-b15b-4080-8dfb-3d03e25fb3d7 tempest-VolumesActionsTest-65705369 None] Detach volume completed successfully.
Aug 27 21:09:41.655400 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e7ec38cd-b15b-4080-8dfb-3d03e25fb3d7 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:41.896860 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-ddbec066-4aff-4026-ac3c-8142d8e3c801 req-36a43492-c918-4c96-90be-9a5f39c62f63 tempest-ServerRescueNegativeTestJSON-904246104 None] Terminate volume connection completed successfully.
Aug 27 21:09:41.897276 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-ddbec066-4aff-4026-ac3c-8142d8e3c801 req-36a43492-c918-4c96-90be-9a5f39c62f63 tempest-ServerRescueNegativeTestJSON-904246104 None] Deleting attachment 47ca9ef7-27f5-4f1e-83ee-09ec259c4f40. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:09:51.049046 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=24,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:09:51.250475 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-1d6ef5e3-42ed-4bf4-bdaf-1d342addd891 tempest-VolumesActionsTest-65705369 None] Running cmd (subprocess): rbd export --pool volumes volume-4343cc59-8a25-4226-bcf3-d0780e045c66 /opt/stack/data/cinder/conversion/volume-4343cc59-8a25-4226-bcf3-d0780e045c66-1913ee5e-ad67-424f-89d5-4d67679ddfc8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:09:52.582730 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-1d6ef5e3-42ed-4bf4-bdaf-1d342addd891 tempest-VolumesActionsTest-65705369 None] CMD "rbd export --pool volumes volume-4343cc59-8a25-4226-bcf3-d0780e045c66 /opt/stack/data/cinder/conversion/volume-4343cc59-8a25-4226-bcf3-d0780e045c66-1913ee5e-ad67-424f-89d5-4d67679ddfc8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.332s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:09:52.605621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.image_utils [None req-1d6ef5e3-42ed-4bf4-bdaf-1d342addd891 tempest-VolumesActionsTest-65705369 None] 1913ee5e-ad67-424f-89d5-4d67679ddfc8 was raw, no need to convert to raw {{(pid=133391) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Aug 27 21:09:53.412953 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Acquiring lock "cinder-954fbcb2-8e60-468a-8fb4-ab2f508f825d-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:53.463218 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Lock "cinder-954fbcb2-8e60-468a-8fb4-ab2f508f825d-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:53.552114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:53.606733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:09:53.607481 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Volume volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:09:53.615781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] deleting rbd volume volume-954fbcb2-8e60-468a-8fb4-ab2f508f825d {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:09:53.969291 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:09:53.995766 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (9d06e9a5-772b-4ac8-a8a5-c8fddee7409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:09:54.003723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c422f68-d6da-45f2-8549-aad5bf9d098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.027039 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c422f68-d6da-45f2-8549-aad5bf9d098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1166229416',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b4c86f3463480ab7ea7fc27c7e3c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:09:54Z,use_quota=True,user_id='f0df3ca755314bdc8e8b236abb0924b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.034086 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09d40a9-e771-4d70-ab49-5d068a38c9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.039323 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d09d40a9-e771-4d70-ab49-5d068a38c9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.045821 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9048dd4-1555-4f13-bc61-dd321162052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.050604 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9048dd4-1555-4f13-bc61-dd321162052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'volume_name': 'volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.056501 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc81a68-e764-4d36-83bb-e7bbae7d750a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.061361 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc81a68-e764-4d36-83bb-e7bbae7d750a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.068284 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5449e137-4dfb-4eb8-b1b9-04530af22fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.069572 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Volume 5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'volume_size': 1}
Aug 27 21:09:54.071557 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] creating volume 'volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:09:54.072563 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:54.148123 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:09:54.148548 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:09:54.152405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5449e137-4dfb-4eb8-b1b9-04530af22fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.157254 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33624c-5949-4fa5-902e-7aae53d8fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:09:54.170480 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Created reservations ['04084dc9-78bf-41f3-afde-8f1aa1d87c76', '62e78223-5aa9-4bc6-b97f-884cf06de54c', 'd8a75e04-8933-4e9e-a5c1-92e79b28ce59', '912cbb5d-4fb3-44a1-a59a-5484920d42ca'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:09:54.176060 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 (5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5): created successfully
Aug 27 21:09:54.179841 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e33624c-5949-4fa5-902e-7aae53d8fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:09:54.185396 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (9d06e9a5-772b-4ac8-a8a5-c8fddee7409c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:09:54.203216 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-845528bd-00a5-4481-a450-4a502a695462 tempest-AttachVolumeNegativeTest-737699077 None] Created volume successfully.
Aug 27 21:09:54.250257 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:54.278294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:54.320732 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:09:54.325187 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Deleted volume successfully.
Aug 27 21:09:54.341778 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4f9310a8-07a1-4797-b2f7-02af5ea5790a tempest-ServerRescueNegativeTestJSON-904246104 None] Lock "cinder-954fbcb2-8e60-468a-8fb4-ab2f508f825d-delete_volume" released by "delete_volume" :: held 0.878s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:54.612721 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Acquiring lock "cinder-acd305a5-b2c7-4635-a2cf-500ae342a530-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:09:54.622928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Lock "cinder-acd305a5-b2c7-4635-a2cf-500ae342a530-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:09:54.675613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:54.722654 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:09:54.723080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Volume volume-acd305a5-b2c7-4635-a2cf-500ae342a530 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:09:54.730713 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] deleting rbd volume volume-acd305a5-b2c7-4635-a2cf-500ae342a530 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:09:55.095484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Created reservations ['076754fc-78de-4924-a530-c91f1330cde0', '0b25ebdd-df01-4621-ad7b-94eaf8361836', 'd0f39a1f-bd99-43bf-840a-4ea021416c37', '3ffdaeb2-7bc9-455c-a9ad-f3da91911c1a'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:09:55.154720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:55.182049 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:09:55.210908 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:09:55.216605 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Deleted volume successfully.
Aug 27 21:09:55.235232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e76d579a-1c89-4a28-afa0-fdd3cfda25d6 tempest-ServerRescueNegativeTestJSON-904246104 None] Lock "cinder-acd305a5-b2c7-4635-a2cf-500ae342a530-delete_volume" released by "delete_volume" :: held 0.612s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:09:55.684707 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 req-d7ad69c9-e49d-46d9-b704-11504d3cdd74 tempest-AttachVolumeNegativeTest-737699077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:09:56.773446 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 req-d7ad69c9-e49d-46d9-b704-11504d3cdd74 tempest-AttachVolumeNegativeTest-737699077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.089s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:09:56.774430 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 req-d7ad69c9-e49d-46d9-b704-11504d3cdd74 tempest-AttachVolumeNegativeTest-737699077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:09:56.800775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 req-d7ad69c9-e49d-46d9-b704-11504d3cdd74 tempest-AttachVolumeNegativeTest-737699077 None] Connection info returned from driver {'name': 'volumes/volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5344c124-1989-42f8-be13-54d72b56ff32'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:09:56.863201 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-83c5e8a3-2df8-44b3-9b53-d0b2bb3f74f9 req-d7ad69c9-e49d-46d9-b704-11504d3cdd74 tempest-AttachVolumeNegativeTest-737699077 None] attachment_update completed successfully.
Aug 27 21:10:00.417536 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-b45fe849-185f-47ae-a708-2bff6ddccb49 req-7453057c-ccbd-4894-be35-b9e5053b93c5 tempest-AttachVolumeNegativeTest-737699077 None] Terminate volume connection completed successfully.
Aug 27 21:10:00.418287 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-b45fe849-185f-47ae-a708-2bff6ddccb49 req-7453057c-ccbd-4894-be35-b9e5053b93c5 tempest-AttachVolumeNegativeTest-737699077 None] Deleting attachment 5344c124-1989-42f8-be13-54d72b56ff32. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:10:02.865923 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:10:02.866711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:02.895440 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:02.948187 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:10:11.037123 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=64,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:10:13.840883 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1d6ef5e3-42ed-4bf4-bdaf-1d342addd891 tempest-VolumesActionsTest-65705369 None] Uploaded volume to glance image-id: 1913ee5e-ad67-424f-89d5-4d67679ddfc8. {{(pid=133391) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}}
Aug 27 21:10:13.869798 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1d6ef5e3-42ed-4bf4-bdaf-1d342addd891 tempest-VolumesActionsTest-65705369 None] Copy volume to image completed successfully.
Aug 27 21:10:15.291783 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Acquiring lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:10:15.337812 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:10:15.381077 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:15.435066 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:10:15.435703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Volume volume-4343cc59-8a25-4226-bcf3-d0780e045c66 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:10:15.458575 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] deleting rbd volume volume-4343cc59-8a25-4226-bcf3-d0780e045c66 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:10:15.788178 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Created reservations ['952dd75e-3b43-4303-9ee2-51de0746be83', '47346318-755d-4ff6-9338-fe4c9038a06b', 'e0069ec3-2c57-4338-94ae-ef5482053ac8', '03cc9600-0355-40b8-8229-9a72a76ea54e'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:10:15.886067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:15.920701 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:15.966643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:10:15.970861 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Deleted volume successfully.
Aug 27 21:10:15.986023 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2de1c359-2b6e-4188-88a5-9018c03c56f1 tempest-VolumesActionsTest-65705369 None] Lock "cinder-4343cc59-8a25-4226-bcf3-d0780e045c66-delete_volume" released by "delete_volume" :: held 0.650s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:10:19.079043 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:10:19.100083 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Flow 'volume_create_manager' (b6315066-3e0b-42e3-8ffc-ee7e2b06a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:10:19.107717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b0b88-fde5-4493-993f-960ed72a7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.127321 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b0b88-fde5-4493-993f-960ed72a7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2107259902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=319f955b-a788-4cf6-b9b5-d29e94cf1df2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe781a6e4c94356b187b81d4b1bcc67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:10:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:10:19Z,use_quota=True,user_id='23266708fe6b4e67ae6a70c038e92c05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.132986 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579abc02-e878-46af-a288-ece0090a9c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.137469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579abc02-e878-46af-a288-ece0090a9c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.142412 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc44fac-6cd3-46fb-9922-8cd08829346a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.146390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc44fac-6cd3-46fb-9922-8cd08829346a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '319f955b-a788-4cf6-b9b5-d29e94cf1df2', 'volume_name': 'volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2', 'volume_size': 2}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.151759 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b583b604-6528-48c9-a2ec-5fec2496a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.155946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b583b604-6528-48c9-a2ec-5fec2496a600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.161049 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49f1de9-6b34-4a49-be8d-67fd6aa37c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.162144 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Volume 319f955b-a788-4cf6-b9b5-d29e94cf1df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2', 'volume_size': 2}
Aug 27 21:10:19.162547 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] creating volume 'volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:10:19.163325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:19.236865 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:10:19.237239 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:10:19.240966 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49f1de9-6b34-4a49-be8d-67fd6aa37c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2', 'volume_size': 2}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.245530 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65c6020-0e4c-463c-8c64-9e08e394aeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:10:19.257725 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Volume volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2 (319f955b-a788-4cf6-b9b5-d29e94cf1df2): created successfully
Aug 27 21:10:19.261530 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a65c6020-0e4c-463c-8c64-9e08e394aeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:10:19.267005 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Flow 'volume_create_manager' (b6315066-3e0b-42e3-8ffc-ee7e2b06a086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:10:19.275921 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d3f9e40e-9b71-496f-83c5-d47c03b85ae1 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Created volume successfully.
Aug 27 21:10:20.343681 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-22ae8115-fa24-4b82-80a1-0dd6e8ec9d92 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:20.676017 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=64,cinder:UPDATE=31,cinder:INSERT=3,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:10:20.697881 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-22ae8115-fa24-4b82-80a1-0dd6e8ec9d92 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Create snapshot completed successfully
Aug 27 21:10:21.506600 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Acquiring lock "cinder-2d1fff37-8ac4-4f6b-b847-d60f0958a8c1-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:10:21.519419 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Lock "cinder-2d1fff37-8ac4-4f6b-b847-d60f0958a8c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:10:21.521989 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:22.751095 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:10:22.774642 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Created reservations ['b461451a-9f84-467a-8bf6-ef555c2f3c01', '723bbada-45d8-4c84-8b93-24f3c4804620', 'ea00d44c-bc8a-412b-b981-eceab82fbd31', '77e5c71d-a189-4046-b64f-75ac5729942d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:10:22.839563 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Delete snapshot completed successfully.
Aug 27 21:10:22.845448 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-885643a1-80a0-4e42-9f75-5235fe80f066 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Lock "cinder-2d1fff37-8ac4-4f6b-b847-d60f0958a8c1-delete_snapshot" released by "delete_snapshot" :: held 1.326s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:10:23.708845 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Acquiring lock "cinder-319f955b-a788-4cf6-b9b5-d29e94cf1df2-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:10:23.721408 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Lock "cinder-319f955b-a788-4cf6-b9b5-d29e94cf1df2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:10:23.762230 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:23.840556 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:10:23.840981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Volume volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:10:23.853090 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] deleting rbd volume volume-319f955b-a788-4cf6-b9b5-d29e94cf1df2 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:10:24.191028 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Created reservations ['3856baba-c421-4534-be36-160004198cbf', 'fb21adef-55ed-4158-aba6-c1223c0824ab', '0a113b1f-c96c-464c-8e03-37b53d686129', 'd092304b-a94e-49c9-8d3a-464e56368a60'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:10:24.278203 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:24.350324 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:10:24.394475 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:10:24.398842 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Deleted volume successfully.
Aug 27 21:10:24.415992 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8b7173d1-461e-4ccd-9632-766304116b73 tempest-VolumesSnapshotNegativeTestJSON-743474457 None] Lock "cinder-319f955b-a788-4cf6-b9b5-d29e94cf1df2-delete_volume" released by "delete_volume" :: held 0.694s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:10:41.048303 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=28,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:10:51.048315 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=49,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:02.863782 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:11:02.864918 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:02.905376 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:02.981024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:08.591620 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:11:08.624379 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (a18d4ce6-2bcd-4ce7-9d66-418fc8e90a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:11:08.642286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e33d26c-8ecf-489a-b89d-9600eaddf558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.679715 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e33d26c-8ecf-489a-b89d-9600eaddf558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:11:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1245852815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=61a807d3-b11f-43f6-965d-0da042564d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a854ce08e212478fbc2bb8eb7d78b145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:11:09Z,use_quota=True,user_id='7266d6f3c5f44e758e222cf97e0cda65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:08.695129 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4409622-019a-452b-a4d7-919544488ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.706311 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4409622-019a-452b-a4d7-919544488ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:08.717474 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c639d37c-4628-4d01-8772-2aa6cb73cbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.728026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c639d37c-4628-4d01-8772-2aa6cb73cbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a807d3-b11f-43f6-965d-0da042564d73', 'volume_name': 'volume-61a807d3-b11f-43f6-965d-0da042564d73', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:08.738853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965ae0e6-607c-4948-9071-34d6470f5e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.748471 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965ae0e6-607c-4948-9071-34d6470f5e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:08.775142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824f2f78-7f75-47ba-b3dd-2ff0a7652f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.776329 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Volume 61a807d3-b11f-43f6-965d-0da042564d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a807d3-b11f-43f6-965d-0da042564d73', 'volume_size': 1}
Aug 27 21:11:08.785939 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] creating volume 'volume-61a807d3-b11f-43f6-965d-0da042564d73' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:11:08.788644 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:08.951807 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:11:08.952456 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:11:08.956694 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824f2f78-7f75-47ba-b3dd-2ff0a7652f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a807d3-b11f-43f6-965d-0da042564d73', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:08.962533 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbc908-ec6f-47a0-ac58-4af1544ed073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:08.996491 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-61a807d3-b11f-43f6-965d-0da042564d73 (61a807d3-b11f-43f6-965d-0da042564d73): created successfully
Aug 27 21:11:09.001636 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bbc908-ec6f-47a0-ac58-4af1544ed073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:09.014801 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (a18d4ce6-2bcd-4ce7-9d66-418fc8e90a49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:11:09.059435 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d7647e19-461c-4828-a073-9bdfeb19b14c tempest-AttachVolumeTestJSON-1033298169 None] Created volume successfully.
Aug 27 21:11:10.283848 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d req-2a75467d-03a2-44f1-a3c2-63409340434a tempest-AttachVolumeTestJSON-1033298169 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:11:11.352978 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d req-2a75467d-03a2-44f1-a3c2-63409340434a tempest-AttachVolumeTestJSON-1033298169 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.069s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:11:11.353773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d req-2a75467d-03a2-44f1-a3c2-63409340434a tempest-AttachVolumeTestJSON-1033298169 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-61a807d3-b11f-43f6-965d-0da042564d73', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '61a807d3-b11f-43f6-965d-0da042564d73', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:11:11.355948 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=13,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:11.380419 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d req-2a75467d-03a2-44f1-a3c2-63409340434a tempest-AttachVolumeTestJSON-1033298169 None] Connection info returned from driver {'name': 'volumes/volume-61a807d3-b11f-43f6-965d-0da042564d73', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '61a807d3-b11f-43f6-965d-0da042564d73', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '84827fe9-d279-4db1-b665-314c70ea4ac6'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:11:11.454163 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-7b139ee9-8ea9-497a-9ce4-f0a5d553270d req-2a75467d-03a2-44f1-a3c2-63409340434a tempest-AttachVolumeTestJSON-1033298169 None] attachment_update completed successfully.
Aug 27 21:11:21.446960 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=5,cinder:SELECT=18 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:41.028935 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:41.449463 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:41.457270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:11:41.478145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (d5cd9826-f496-4eee-ac39-62a976aecb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:11:41.485011 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470c55d3-0f45-42b7-b94d-e4341e5454b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.503080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (470c55d3-0f45-42b7-b94d-e4341e5454b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-833001198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=116450af-17af-42c9-8d69-d6f0f35c3c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b4c86f3463480ab7ea7fc27c7e3c16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:11:41Z,use_quota=True,user_id='f0df3ca755314bdc8e8b236abb0924b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.514517 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968af596-8d82-4ea0-b0d2-b7a66c75faf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.518635 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (968af596-8d82-4ea0-b0d2-b7a66c75faf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.524043 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1a386f-d006-430e-92a9-b4a84c377cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.528657 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c1a386f-d006-430e-92a9-b4a84c377cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116450af-17af-42c9-8d69-d6f0f35c3c21', 'volume_name': 'volume-116450af-17af-42c9-8d69-d6f0f35c3c21', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.534412 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892df8ae-407c-4996-bd5d-8d5ed2256a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.538289 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892df8ae-407c-4996-bd5d-8d5ed2256a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.542894 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f30551-433b-45ce-b9dc-1d02de3d5c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.543980 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Volume 116450af-17af-42c9-8d69-d6f0f35c3c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116450af-17af-42c9-8d69-d6f0f35c3c21', 'volume_size': 1}
Aug 27 21:11:41.544383 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] creating volume 'volume-116450af-17af-42c9-8d69-d6f0f35c3c21' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:11:41.545143 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:41.619024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:11:41.620548 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:11:41.626304 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68f30551-433b-45ce-b9dc-1d02de3d5c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116450af-17af-42c9-8d69-d6f0f35c3c21', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.631596 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616e886b-ab4d-48c5-8d68-bfd85d3c9212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:11:41.643818 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-116450af-17af-42c9-8d69-d6f0f35c3c21 (116450af-17af-42c9-8d69-d6f0f35c3c21): created successfully
Aug 27 21:11:41.648603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616e886b-ab4d-48c5-8d68-bfd85d3c9212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:11:41.655903 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Flow 'volume_create_manager' (d5cd9826-f496-4eee-ac39-62a976aecb46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:11:41.666085 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-310a6957-1240-4951-88dd-3e722c4eaa37 tempest-AttachVolumeNegativeTest-737699077 None] Created volume successfully.
Aug 27 21:11:43.147828 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 req-8d818e2f-139a-4f9d-a373-55d8b5afc44a tempest-AttachVolumeNegativeTest-737699077 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:11:43.999054 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 req-8d818e2f-139a-4f9d-a373-55d8b5afc44a tempest-AttachVolumeNegativeTest-737699077 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.851s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:11:43.999807 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 req-8d818e2f-139a-4f9d-a373-55d8b5afc44a tempest-AttachVolumeNegativeTest-737699077 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-116450af-17af-42c9-8d69-d6f0f35c3c21', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '116450af-17af-42c9-8d69-d6f0f35c3c21', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:11:44.033610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 req-8d818e2f-139a-4f9d-a373-55d8b5afc44a tempest-AttachVolumeNegativeTest-737699077 None] Connection info returned from driver {'name': 'volumes/volume-116450af-17af-42c9-8d69-d6f0f35c3c21', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '116450af-17af-42c9-8d69-d6f0f35c3c21', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '49266998-b69f-4b41-9b32-96a887df3ae0'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:11:44.117291 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-6ad6f266-0ee7-4ed3-a901-94d79d545c43 req-8d818e2f-139a-4f9d-a373-55d8b5afc44a tempest-AttachVolumeNegativeTest-737699077 None] attachment_update completed successfully.
Aug 27 21:11:47.518450 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 req-9555f692-b817-4544-ab29-bb055422792a tempest-AttachVolumeNegativeTest-737699077 None] Terminate volume connection completed successfully.
Aug 27 21:11:47.519016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-f4b9cdfc-4dbd-4b37-bdfa-3b6ea769d198 req-9555f692-b817-4544-ab29-bb055422792a tempest-AttachVolumeNegativeTest-737699077 None] Deleting attachment 49266998-b69f-4b41-9b32-96a887df3ae0. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:11:50.260680 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-35c6a53e-b8a9-4d1f-94db-350396a5ce88 tempest-TaggedBootDevicesTest_v242-1042837722 None] Terminate volume connection completed successfully.
Aug 27 21:11:50.261272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-35c6a53e-b8a9-4d1f-94db-350396a5ce88 tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleting attachment e6e2d1f0-10dc-40c5-b775-613e69e60fe5. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:11:50.408973 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-2dbe3072-10d0-4224-a27d-e0fc3718b8a1 tempest-TaggedBootDevicesTest_v242-1042837722 None] Terminate volume connection completed successfully.
Aug 27 21:11:50.409634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-2dbe3072-10d0-4224-a27d-e0fc3718b8a1 tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleting attachment bef9e7c1-076d-42d6-850c-1b63d249f538. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:11:50.557693 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-773bb3c9-a6db-4e91-b11a-818857e99f18 tempest-TaggedBootDevicesTest_v242-1042837722 None] Terminate volume connection completed successfully.
Aug 27 21:11:50.558111 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-b610e57f-5ebe-4706-93fc-972c14633ee9 req-773bb3c9-a6db-4e91-b11a-818857e99f18 tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleting attachment ff9c990a-f1fe-4cb4-9912-7c43babc1e7e. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:11:53.832931 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Acquiring lock "cinder-116450af-17af-42c9-8d69-d6f0f35c3c21-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:53.847829 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-116450af-17af-42c9-8d69-d6f0f35c3c21-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:53.888897 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:53.936621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:53.937068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-116450af-17af-42c9-8d69-d6f0f35c3c21 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:11:53.947802 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] deleting rbd volume volume-116450af-17af-42c9-8d69-d6f0f35c3c21 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:54.300089 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Created reservations ['1bc86fbb-d241-4304-a278-185137160816', '5c341eed-f684-41e4-adc9-59bc3a03bf5a', 'd0860678-22e9-46de-949d-38eb5065c8a6', 'cf18edf2-d8f7-44a8-a9ae-659f86b596c0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:54.401650 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:54.487961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:54.555391 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:54.560731 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Deleted volume successfully.
Aug 27 21:11:54.579365 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1865ede2-3cef-43c8-9634-73a5a42670ca tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-116450af-17af-42c9-8d69-d6f0f35c3c21-delete_volume" released by "delete_volume" :: held 0.731s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:11:55.391910 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Acquiring lock "cinder-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:55.404984 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:55.466907 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:55.558207 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:55.558626 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:11:55.566999 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] deleting rbd volume volume-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:55.840648 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Created reservations ['af943346-df56-4a63-b655-2904aa08d96c', '9b00e03f-2206-4588-8421-31eefbe28d1c', '07ee339d-0645-455e-892a-6834a5f6fb06', '08abc198-29f5-41e5-8fc7-10247004b804'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:55.900879 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:55.951187 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:55.990512 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:56.008179 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Deleted volume successfully.
Aug 27 21:11:56.025259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5bcab92e-c5f9-4c51-b2fb-4bc3f85f42d3 tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-5b69ae5e-35db-4e5d-a2b4-00e5507d3aa5-delete_volume" released by "delete_volume" :: held 0.622s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:11:56.072094 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Acquiring lock "cinder-80f8feb0-5bbf-4857-8078-a818ff55caea-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:56.098085 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-80f8feb0-5bbf-4857-8078-a818ff55caea-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:56.132232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:56.175109 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:56.175556 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-80f8feb0-5bbf-4857-8078-a818ff55caea is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:11:56.182868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] deleting rbd volume volume-80f8feb0-5bbf-4857-8078-a818ff55caea {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:56.453926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Created reservations ['bf18e642-8dc1-41f1-a7ad-304cb719407d', '1b31db9a-351b-4e30-b8a6-8f8de0aed00e', '819d4820-4e97-4430-b5ba-c9162020b471', '935f9fcb-5fa0-4166-855e-1e2d2a126658'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:56.504453 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:56.539067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:56.571179 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:56.576412 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleted volume successfully.
Aug 27 21:11:56.580314 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=65,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:56.593509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8eb7d7b8-bcca-4c68-807e-66e2caf72efc tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-80f8feb0-5bbf-4857-8078-a818ff55caea-delete_volume" released by "delete_volume" :: held 0.495s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:11:57.118682 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Acquiring lock "cinder-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:57.130106 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:57.176218 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:57.256647 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:57.257057 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Volume volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:11:57.262980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] deleting rbd volume volume-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:57.267658 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Acquiring lock "cinder-7bb09a2e-9d97-407e-a8bf-817e7b438724-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:57.282331 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-7bb09a2e-9d97-407e-a8bf-817e7b438724-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:57.318576 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:11:57.324532 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:57.381979 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:57.382326 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Volume volume-7bb09a2e-9d97-407e-a8bf-817e7b438724 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:11:57.398683 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] deleting rbd volume volume-7bb09a2e-9d97-407e-a8bf-817e7b438724 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:57.742236 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Created reservations ['b86646ef-d2da-4f5a-a19d-f1d2b0f77ac5', '29248914-f0ba-4e7f-8e25-7abe9a3dec6c', 'ca942ace-dbf7-42e3-9abf-123bc9c6286c', '05204bb9-af32-47a7-8e9b-13c5c04f7a0f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:57.819591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:57.882017 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:57.944796 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:57.969621 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Deleted volume successfully.
Aug 27 21:11:57.988822 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a85bcb0d-caf4-4881-b3fe-5a14f6ff18e2 tempest-AttachVolumeNegativeTest-737699077 None] Lock "cinder-6c6c2ab5-a48b-48f4-9a27-2fd8c70ec495-delete_volume" released by "delete_volume" :: held 0.859s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:11:58.012886 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Created reservations ['121308fa-8dad-4067-92b1-200c849a111e', '38c0b226-03dc-4377-b867-8c79188d2860', 'fb40af11-5041-4306-9b8d-bade132d8a2e', 'a96d64dc-90f6-4689-ba68-6cfdfe1fd157'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:58.068469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:58.120194 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:58.176804 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:11:58.183538 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleted volume successfully.
Aug 27 21:11:58.211554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0bcef80c-7c94-444e-87fb-f566605e66fb tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-7bb09a2e-9d97-407e-a8bf-817e7b438724-delete_volume" released by "delete_volume" :: held 0.929s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:11:58.426921 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Acquiring lock "cinder-4e2488ca-6bf7-4eec-90ad-0aee15955f29-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:11:58.441037 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-4e2488ca-6bf7-4eec-90ad-0aee15955f29-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:11:58.517378 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:58.622466 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:11:58.633489 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] deleting rbd volume volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:11:59.033607 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:11:59.069630 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] deleting parent snapshot volume-4e2488ca-6bf7-4eec-90ad-0aee15955f29.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:11:59.833886 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Created reservations ['04603ffa-6f97-4401-afb9-53663bb2e2fb', 'd7ba5053-0893-48ea-b663-755149fde56e', '42f1911b-d9ed-4ea0-aaab-c49555d210ff', 'dc5c5e30-11a7-48d9-a965-5f3457ed9a90'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:11:59.913897 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:11:59.956435 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:00.048870 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:12:00.053982 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Deleted volume successfully.
Aug 27 21:12:00.071155 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c91a4471-245a-46ce-a8b7-386d13f848b5 tempest-TaggedBootDevicesTest_v242-1042837722 None] Lock "cinder-4e2488ca-6bf7-4eec-90ad-0aee15955f29-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:12:02.695664 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-86ac880b-0d03-4268-b6a0-e2fd34264ff9 tempest-TaggedBootDevicesTest-326852622 None] Terminate volume connection completed successfully.
Aug 27 21:12:02.697995 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-86ac880b-0d03-4268-b6a0-e2fd34264ff9 tempest-TaggedBootDevicesTest-326852622 None] Deleting attachment 2bb66f35-2f83-41cb-9f3e-a5357940f4eb. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:12:02.868014 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:12:02.869690 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:02.964544 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:03.049059 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:12:03.077617 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-0d655369-4332-4675-ba26-0e3ee1ace1a9 tempest-TaggedBootDevicesTest-326852622 None] Terminate volume connection completed successfully.
Aug 27 21:12:03.078407 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-0d655369-4332-4675-ba26-0e3ee1ace1a9 tempest-TaggedBootDevicesTest-326852622 None] Deleting attachment 0114858d-1e30-441c-a5df-dfaf11fb644e. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:12:03.234180 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-c030f3c3-b674-4828-8a3a-91d4a4fd8016 tempest-TaggedBootDevicesTest-326852622 None] Terminate volume connection completed successfully.
Aug 27 21:12:03.235632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1fe22d41-f126-42ab-bf6f-8368c72941d1 req-c030f3c3-b674-4828-8a3a-91d4a4fd8016 tempest-TaggedBootDevicesTest-326852622 None] Deleting attachment 78bd1bdc-39be-45bb-a8f7-c2d4bdac7b68. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:12:10.280828 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Acquiring lock "cinder-a8c2b98b-2f95-421a-96ce-82bbd3cabd81-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:12:10.316039 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-a8c2b98b-2f95-421a-96ce-82bbd3cabd81-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:12:10.417943 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:10.498678 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:12:10.499981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Volume volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:12:10.514652 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] deleting rbd volume volume-a8c2b98b-2f95-421a-96ce-82bbd3cabd81 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:12:10.919292 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Created reservations ['51c89707-83b4-4bf9-ae48-50353702aa71', 'e9ac0fee-f42a-435c-9e9f-eaafaaef9254', 'b6442b98-074f-4cec-ab5d-8992e8e2fae5', '4f7ce989-9734-4463-ab6e-29f1b11af972'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:12:11.000912 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:11.058288 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:11.116241 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:12:11.125353 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Deleted volume successfully.
Aug 27 21:12:11.144899 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-aa49b471-90f5-4aef-89a0-412b6fc8236e tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-a8c2b98b-2f95-421a-96ce-82bbd3cabd81-delete_volume" released by "delete_volume" :: held 0.835s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:12:11.524210 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Acquiring lock "cinder-31351cef-5982-4d71-9c5e-aa314e882454-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:12:11.541596 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-31351cef-5982-4d71-9c5e-aa314e882454-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:12:11.571121 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=58,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:12:11.627890 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=57,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:12:11.632120 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:11.694948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:12:11.695550 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Volume volume-31351cef-5982-4d71-9c5e-aa314e882454 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:12:11.707588 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] deleting rbd volume volume-31351cef-5982-4d71-9c5e-aa314e882454 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:12:12.042183 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Created reservations ['a576427b-0a0c-4959-8624-f8f48b772b16', '5ae1aa34-6d84-49af-8109-7a5a4cbf9e86', '70852968-f270-4bcd-b8d2-21fe871e585f', '2d181ec3-6e82-4647-a99f-188a4ae1486d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:12:12.090133 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:12.128042 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:12.177983 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:12:12.183831 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Deleted volume successfully.
Aug 27 21:12:12.199219 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fe0b3142-e1fc-47f9-b928-ca7adac898c1 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-31351cef-5982-4d71-9c5e-aa314e882454-delete_volume" released by "delete_volume" :: held 0.659s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:12:12.750172 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Acquiring lock "cinder-ff8fefeb-4f39-4b64-911f-d2ce862755c0-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:12:12.778098 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-ff8fefeb-4f39-4b64-911f-d2ce862755c0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:12:12.908509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:13.012724 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:12:13.024859 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] deleting rbd volume volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:12:13.337847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:12:13.377285 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] deleting parent snapshot volume-ff8fefeb-4f39-4b64-911f-d2ce862755c0.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:12:13.656421 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Created reservations ['99933ed1-1f39-432b-a048-ad7c97ac2b46', 'ac7f5a8c-0a77-464a-8273-ff2486647575', '961afff7-e18e-4b36-8c47-90b0018f8f91', 'd15582de-7b27-47cc-990b-e55903ed833f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:12:13.715065 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:13.750369 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:13.785635 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:12:13.791476 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Deleted volume successfully.
Aug 27 21:12:13.805294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c034805-14bd-426d-829b-96faf0272156 tempest-TaggedBootDevicesTest-326852622 None] Lock "cinder-ff8fefeb-4f39-4b64-911f-d2ce862755c0-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:12:23.794150 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:12:38.729186 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 req-6994ae85-506e-45de-b1d7-be4dd84498d7 tempest-AttachVolumeTestJSON-1033298169 None] Terminate volume connection completed successfully.
Aug 27 21:12:38.729755 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-95ac0819-dcb2-4ac4-bc09-7a165c47d421 req-6994ae85-506e-45de-b1d7-be4dd84498d7 tempest-AttachVolumeTestJSON-1033298169 None] Deleting attachment 84827fe9-d279-4db1-b665-314c70ea4ac6. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:12:41.446344 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:12:41.528390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Flow 'volume_create_manager' (02481d74-fa4a-488c-bd7a-cb3779ff9a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:12:41.541114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa1d9f4-ef9e-402a-84b0-1a3853dcadcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.576708 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa1d9f4-ef9e-402a-84b0-1a3853dcadcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-731838461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ebdf631-522c-4ca4-8edd-98bd7239f81e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fcf33563bb4c08852f48ad3cb2eed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:12:41Z,use_quota=True,user_id='3ed5b662d08e405395b930a185b78d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.591801 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef55e8ca-e59d-41dc-91b9-96eb67add485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.600072 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef55e8ca-e59d-41dc-91b9-96eb67add485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.606231 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ce2cb8-72f0-42e4-aff3-3aec6e02949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.610885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14ce2cb8-72f0-42e4-aff3-3aec6e02949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'volume_name': 'volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.616043 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77fcc23-9cf2-4a99-85e5-83afd19a32ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.620190 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77fcc23-9cf2-4a99-85e5-83afd19a32ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.625250 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0d467a-587c-40a1-91c9-080c3c602eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.627298 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume 0ebdf631-522c-4ca4-8edd-98bd7239f81e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'volume_size': 1}
Aug 27 21:12:41.627968 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] creating volume 'volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:12:41.628980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:12:41.814153 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:12:41.815003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:12:41.819510 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e0d467a-587c-40a1-91c9-080c3c602eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.828726 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc30ce-25ef-460c-81a8-232f6aab4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:12:41.837617 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=36,cinder:INSERT=4,cinder:UPDATE=23 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:12:41.853998 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e (0ebdf631-522c-4ca4-8edd-98bd7239f81e): created successfully
Aug 27 21:12:41.861364 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdc30ce-25ef-460c-81a8-232f6aab4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:12:41.873050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Flow 'volume_create_manager' (02481d74-fa4a-488c-bd7a-cb3779ff9a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:12:41.897662 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-dab0bb75-47e5-487a-b1f3-7327e187ef58 tempest-AttachVolumeShelveTestJSON-1808861972 None] Created volume successfully.
Aug 27 21:12:51.881981 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:13:02.861507 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:13:02.862164 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:13:02.915793 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:13:02.986744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:13:11.142524 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=6,cinder:DELETE=1,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:13:29.993769 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:13:30.019843 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-94714fba-ffb2-488d-bc38-022bc5be62dc req-634da340-88d1-44c4-94a5-dc6f3cc3e0aa tempest-AttachVolumeShelveTestJSON-1808861972 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:13:31.386656 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-94714fba-ffb2-488d-bc38-022bc5be62dc req-634da340-88d1-44c4-94a5-dc6f3cc3e0aa tempest-AttachVolumeShelveTestJSON-1808861972 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.372s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:13:31.388043 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-94714fba-ffb2-488d-bc38-022bc5be62dc req-634da340-88d1-44c4-94a5-dc6f3cc3e0aa tempest-AttachVolumeShelveTestJSON-1808861972 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:13:31.421739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-94714fba-ffb2-488d-bc38-022bc5be62dc req-634da340-88d1-44c4-94a5-dc6f3cc3e0aa tempest-AttachVolumeShelveTestJSON-1808861972 None] Connection info returned from driver {'name': 'volumes/volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0ebdf631-522c-4ca4-8edd-98bd7239f81e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5126aef0-fd9b-4b69-8f61-b1d974637ac1'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:13:31.493702 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-94714fba-ffb2-488d-bc38-022bc5be62dc req-634da340-88d1-44c4-94a5-dc6f3cc3e0aa tempest-AttachVolumeShelveTestJSON-1808861972 None] attachment_update completed successfully.
Aug 27 21:13:41.492056 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:13:51.147828 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=16,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:14:01.140235 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:14:02.857827 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:14:02.860154 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:14:02.946528 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:14:03.016881 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:14:29.496360 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:14:29.514572 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:14:29.544842 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Flow 'volume_create_manager' (f5f7ebfe-7248-4002-b090-a4b16ee4c658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:14:29.551869 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57667409-469a-44eb-84e7-f6c1cc2672c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.573718 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57667409-469a-44eb-84e7-f6c1cc2672c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1103268840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=243c58b5-d48f-4f79-bb94-6ae6a0febe12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cc1bb296014690bb72ae59829e5218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:14:29Z,use_quota=True,user_id='fe51e589dc00446cb71cc2c4b3cdbc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.581649 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09998ff5-b153-41be-ab3c-a2bbe3faae56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.585868 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09998ff5-b153-41be-ab3c-a2bbe3faae56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.596590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dedc14d-d64c-48df-94f6-966efaf78c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.598659 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dedc14d-d64c-48df-94f6-966efaf78c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '243c58b5-d48f-4f79-bb94-6ae6a0febe12', 'volume_name': 'volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.604095 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7682987c-d916-4d09-983b-dc6aa61b3373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.609196 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7682987c-d916-4d09-983b-dc6aa61b3373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.616109 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7d49d6-0d4e-4778-aada-a6a1ff2f532d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.617312 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Volume 243c58b5-d48f-4f79-bb94-6ae6a0febe12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12', 'volume_size': 1}
Aug 27 21:14:29.617720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] creating volume 'volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:14:29.618391 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:14:29.793152 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:14:29.793855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:14:29.798142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7d49d6-0d4e-4778-aada-a6a1ff2f532d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.813669 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058b02b8-239d-4776-8873-0396928563a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:29.833215 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Volume volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12 (243c58b5-d48f-4f79-bb94-6ae6a0febe12): created successfully
Aug 27 21:14:29.838168 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058b02b8-239d-4776-8873-0396928563a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:29.851589 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Flow 'volume_create_manager' (f5f7ebfe-7248-4002-b090-a4b16ee4c658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:14:29.868380 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7d1bf6a8-43b6-489b-8de3-f94366e6719e tempest-ServersNegativeTestJSON-1621363259 None] Created volume successfully.
Aug 27 21:14:32.226745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:14:32.249552 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Flow 'volume_create_manager' (133f0535-8723-426b-a6bd-18eeaba59e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:14:32.257280 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f957c57c-7e3b-4dc4-ac86-380f9a0dd352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.278611 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f957c57c-7e3b-4dc4-ac86-380f9a0dd352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1714778980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7df4d62a-058f-4e7c-ac49-6e122cfad404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cc1bb296014690bb72ae59829e5218',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:14:32Z,use_quota=True,user_id='fe51e589dc00446cb71cc2c4b3cdbc3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.286775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4a091f-69f8-4a67-928f-94c0329f8a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.292846 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4a091f-69f8-4a67-928f-94c0329f8a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.299957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc6e8f3-f057-4586-b99c-2b65fff41c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.304667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fc6e8f3-f057-4586-b99c-2b65fff41c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df4d62a-058f-4e7c-ac49-6e122cfad404', 'volume_name': 'volume-7df4d62a-058f-4e7c-ac49-6e122cfad404', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.310532 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab3747e-0982-4fd5-8e3f-fdd1f3b1e3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.315423 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab3747e-0982-4fd5-8e3f-fdd1f3b1e3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.324509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed633253-d185-463f-9405-d391a566dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.326030 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Volume 7df4d62a-058f-4e7c-ac49-6e122cfad404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df4d62a-058f-4e7c-ac49-6e122cfad404', 'volume_size': 1}
Aug 27 21:14:32.326530 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] creating volume 'volume-7df4d62a-058f-4e7c-ac49-6e122cfad404' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:14:32.327294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:14:32.436008 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:14:32.437182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:14:32.441134 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed633253-d185-463f-9405-d391a566dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df4d62a-058f-4e7c-ac49-6e122cfad404', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.447681 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd103079-7277-409e-8ec0-14df71b5bf3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:14:32.479048 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Volume volume-7df4d62a-058f-4e7c-ac49-6e122cfad404 (7df4d62a-058f-4e7c-ac49-6e122cfad404): created successfully
Aug 27 21:14:32.484197 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd103079-7277-409e-8ec0-14df71b5bf3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:14:32.496472 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Flow 'volume_create_manager' (133f0535-8723-426b-a6bd-18eeaba59e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:14:32.534319 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-fad84887-d2e7-47a3-a948-8a7c8b05b785 tempest-ServersNegativeTestJSON-1621363259 None] Created volume successfully.
Aug 27 21:14:51.142344 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:15:01.156745 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:15:02.862761 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:15:02.864325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:02.971030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:03.052224 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:15:14.507265 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-24583176-98be-42c8-9fa3-b7412faba93f req-b5c3dbbf-8db7-4968-8961-26445facb18f tempest-AttachVolumeShelveTestJSON-1808861972 None] Terminate volume connection completed successfully.
Aug 27 21:15:14.507905 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-24583176-98be-42c8-9fa3-b7412faba93f req-b5c3dbbf-8db7-4968-8961-26445facb18f tempest-AttachVolumeShelveTestJSON-1808861972 None] Deleting attachment 5126aef0-fd9b-4b69-8f61-b1d974637ac1. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:15:31.151436 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:15:38.630404 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:15:38.669643 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (3f2ec786-7918-4fb0-b3c9-51a714609226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:38.698304 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55936061-9ad0-44c0-a987-97cda30eb600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.737488 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55936061-9ad0-44c0-a987-97cda30eb600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-150103125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0181737c-e695-4334-adad-23facf867139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a854ce08e212478fbc2bb8eb7d78b145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:15:39Z,use_quota=True,user_id='7266d6f3c5f44e758e222cf97e0cda65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:38.751070 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf6ef4-626e-4233-95cd-35121d1a72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.759199 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81bf6ef4-626e-4233-95cd-35121d1a72a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:38.770608 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd3c6f4-384e-482b-b70f-527a2fa99d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.785273 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd3c6f4-384e-482b-b70f-527a2fa99d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0181737c-e695-4334-adad-23facf867139', 'volume_name': 'volume-0181737c-e695-4334-adad-23facf867139', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:38.797946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046a16e4-9e5d-4d06-9ea2-a9447bad7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.803745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046a16e4-9e5d-4d06-9ea2-a9447bad7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:38.816893 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c416eb46-3439-42bf-9ecd-1a7bbc162fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.821471 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Volume 0181737c-e695-4334-adad-23facf867139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0181737c-e695-4334-adad-23facf867139', 'volume_size': 1}
Aug 27 21:15:38.821830 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] creating volume 'volume-0181737c-e695-4334-adad-23facf867139' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:15:38.823590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:38.967640 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:15:38.968019 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:15:38.972334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c416eb46-3439-42bf-9ecd-1a7bbc162fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0181737c-e695-4334-adad-23facf867139', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:38.976834 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd4250-c05a-4954-b32e-4fa1ff298dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:38.999173 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-0181737c-e695-4334-adad-23facf867139 (0181737c-e695-4334-adad-23facf867139): created successfully
Aug 27 21:15:39.003120 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aafd4250-c05a-4954-b32e-4fa1ff298dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:39.009091 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (3f2ec786-7918-4fb0-b3c9-51a714609226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:39.040338 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-aa7e009d-36a0-4926-8753-19c0a0ac7451 tempest-AttachVolumeTestJSON-1033298169 None] Created volume successfully.
Aug 27 21:15:40.854338 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-5d34e525-3f07-4ae6-8619-075b5440595f req-29a6dbbf-b7ad-4632-84b8-d87c5c454ed1 tempest-AttachVolumeTestJSON-1033298169 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:15:42.110660 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-5d34e525-3f07-4ae6-8619-075b5440595f req-29a6dbbf-b7ad-4632-84b8-d87c5c454ed1 tempest-AttachVolumeTestJSON-1033298169 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.256s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:15:42.111609 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-5d34e525-3f07-4ae6-8619-075b5440595f req-29a6dbbf-b7ad-4632-84b8-d87c5c454ed1 tempest-AttachVolumeTestJSON-1033298169 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0181737c-e695-4334-adad-23facf867139', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '0181737c-e695-4334-adad-23facf867139', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:15:42.115197 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:15:42.166610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-5d34e525-3f07-4ae6-8619-075b5440595f req-29a6dbbf-b7ad-4632-84b8-d87c5c454ed1 tempest-AttachVolumeTestJSON-1033298169 None] Connection info returned from driver {'name': 'volumes/volume-0181737c-e695-4334-adad-23facf867139', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0181737c-e695-4334-adad-23facf867139', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4561946e-ff6d-492a-9de5-26a2aa2f354e'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:15:42.242676 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-5d34e525-3f07-4ae6-8619-075b5440595f req-29a6dbbf-b7ad-4632-84b8-d87c5c454ed1 tempest-AttachVolumeTestJSON-1033298169 None] attachment_update completed successfully.
Aug 27 21:15:47.331810 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:15:47.360562 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (16a4577b-a08f-4706-89da-d00e0d070443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:47.370484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87ad758-4cde-4dbb-ab98-8618c7099a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.400612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87ad758-4cde-4dbb-ab98-8618c7099a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1769205047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=92e11cba-093d-477a-884f-674297358856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a854ce08e212478fbc2bb8eb7d78b145',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:15:47Z,use_quota=True,user_id='7266d6f3c5f44e758e222cf97e0cda65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.410955 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc96f8df-112d-42a0-bc69-6a175ab84fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.420365 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc96f8df-112d-42a0-bc69-6a175ab84fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.429777 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528df45e-6885-41e5-a2c6-c0622d9fadb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.435843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (528df45e-6885-41e5-a2c6-c0622d9fadb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92e11cba-093d-477a-884f-674297358856', 'volume_name': 'volume-92e11cba-093d-477a-884f-674297358856', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.442527 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413fcf50-7046-455f-8ca0-8ab738dfe245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.450308 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (413fcf50-7046-455f-8ca0-8ab738dfe245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.465396 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bd5655-9f36-419e-bfb0-0bc35d5ab208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.467930 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Volume 92e11cba-093d-477a-884f-674297358856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92e11cba-093d-477a-884f-674297358856', 'volume_size': 1}
Aug 27 21:15:47.469174 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] creating volume 'volume-92e11cba-093d-477a-884f-674297358856' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:15:47.470874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:47.672726 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:15:47.673667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:15:47.678400 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8bd5655-9f36-419e-bfb0-0bc35d5ab208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92e11cba-093d-477a-884f-674297358856', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.691510 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1403b65-15ea-4638-a2f5-21aa7d297fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:47.718248 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-92e11cba-093d-477a-884f-674297358856 (92e11cba-093d-477a-884f-674297358856): created successfully
Aug 27 21:15:47.728334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1403b65-15ea-4638-a2f5-21aa7d297fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:47.745334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Flow 'volume_create_manager' (16a4577b-a08f-4706-89da-d00e0d070443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:47.770085 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-456eae9d-7763-492d-a6cc-7e3f09827abe tempest-AttachVolumeTestJSON-1033298169 None] Created volume successfully.
Aug 27 21:15:49.330834 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-4424bbb5-88a8-4705-845e-50d1ae84434f req-aea198b2-f3fd-442e-9c4f-b2bba30f3c96 tempest-AttachVolumeTestJSON-1033298169 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:15:49.684981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:15:49.724954 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Flow 'volume_create_manager' (34057b4b-bc14-41ab-8f82-32f540914d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:49.759963 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb85807-47ad-4f70-9e22-259cf3f10a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:49.796279 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb85807-47ad-4f70-9e22-259cf3f10a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1045453927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9f4af3ca-608e-4ac7-8a66-abde29b67378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bc1ca5ce0b34fbf9f16f2a0b60e93ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:15:50Z,use_quota=True,user_id='13d8ca681c254fac8a3f3fd2245dff7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:49.801980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc15cab-f168-4d39-992f-503aa7cd5866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:49.818390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bc15cab-f168-4d39-992f-503aa7cd5866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:49.831538 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8073f600-61ee-4da6-bfb5-8dc8b8b2fcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:49.842424 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8073f600-61ee-4da6-bfb5-8dc8b8b2fcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f4af3ca-608e-4ac7-8a66-abde29b67378', 'volume_name': 'volume-9f4af3ca-608e-4ac7-8a66-abde29b67378', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:49.854118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7f64c-9685-4ac4-b3ff-d10d873f9251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:49.864814 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d7f64c-9685-4ac4-b3ff-d10d873f9251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:49.876834 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fce0fe2-9e7d-471f-82d7-5eeb86345a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:49.879117 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Volume 9f4af3ca-608e-4ac7-8a66-abde29b67378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f4af3ca-608e-4ac7-8a66-abde29b67378', 'volume_size': 1}
Aug 27 21:15:49.881294 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] creating volume 'volume-9f4af3ca-608e-4ac7-8a66-abde29b67378' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:15:49.882181 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:50.062987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:15:50.063376 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:15:50.066982 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fce0fe2-9e7d-471f-82d7-5eeb86345a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f4af3ca-608e-4ac7-8a66-abde29b67378', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:50.084106 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f048b16-2801-4b83-a3d0-d9a7e691895d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:15:50.104425 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Volume volume-9f4af3ca-608e-4ac7-8a66-abde29b67378 (9f4af3ca-608e-4ac7-8a66-abde29b67378): created successfully
Aug 27 21:15:50.108161 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f048b16-2801-4b83-a3d0-d9a7e691895d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:15:50.116334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Flow 'volume_create_manager' (34057b4b-bc14-41ab-8f82-32f540914d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:15:50.139567 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1042ceb5-b98c-4dad-a961-f9a0deb54e41 req-db4d4025-3502-47c4-b4f7-6e1c95dda193 tempest-VolumesSnapshotsTestJSON-808827494 None] Created volume successfully.
Aug 27 21:15:50.502554 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-4424bbb5-88a8-4705-845e-50d1ae84434f req-aea198b2-f3fd-442e-9c4f-b2bba30f3c96 tempest-AttachVolumeTestJSON-1033298169 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.172s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:15:50.504405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-4424bbb5-88a8-4705-845e-50d1ae84434f req-aea198b2-f3fd-442e-9c4f-b2bba30f3c96 tempest-AttachVolumeTestJSON-1033298169 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-92e11cba-093d-477a-884f-674297358856', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '92e11cba-093d-477a-884f-674297358856', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:15:50.544889 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-4424bbb5-88a8-4705-845e-50d1ae84434f req-aea198b2-f3fd-442e-9c4f-b2bba30f3c96 tempest-AttachVolumeTestJSON-1033298169 None] Connection info returned from driver {'name': 'volumes/volume-92e11cba-093d-477a-884f-674297358856', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '92e11cba-093d-477a-884f-674297358856', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '764f1675-be2f-444f-be6c-9c7cd2c5ad4e'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:15:50.655891 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-4424bbb5-88a8-4705-845e-50d1ae84434f req-aea198b2-f3fd-442e-9c4f-b2bba30f3c96 tempest-AttachVolumeTestJSON-1033298169 None] attachment_update completed successfully.
Aug 27 21:15:51.254351 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-518fa5da-35be-4af4-aa26-41ec4432d69d req-cf16a992-631b-4222-9a2e-273773718ae1 tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:52.485283 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-518fa5da-35be-4af4-aa26-41ec4432d69d req-cf16a992-631b-4222-9a2e-273773718ae1 tempest-VolumesSnapshotsTestJSON-808827494 None] Create snapshot completed successfully
Aug 27 21:15:53.778411 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] Acquiring lock "cinder-6decd9cc-1ddf-42e5-8476-8df9624cc7e0-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:15:53.799976 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] Lock "cinder-6decd9cc-1ddf-42e5-8476-8df9624cc7e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:15:53.806188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:54.598749 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] Created reservations ['667028a1-5d51-4a02-a0e6-ba493f79e194', '7eee325b-a477-47da-aa88-dec4590dc768', '6e8547fe-11d0-408e-b883-88c124a5d735', '67368fe5-37e9-49c8-bdd4-5027ecda1d37'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:15:54.745823 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] Delete snapshot completed successfully.
Aug 27 21:15:54.766012 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-602e2ccc-608f-4f38-b6b5-ffe7bd0580b9 req-e28cbd1a-39a7-4588-b9e0-5542dd32739a tempest-VolumesSnapshotsTestJSON-808827494 None] Lock "cinder-6decd9cc-1ddf-42e5-8476-8df9624cc7e0-delete_snapshot" released by "delete_snapshot" :: held 0.966s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:15:55.301301 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Acquiring lock "cinder-9f4af3ca-608e-4ac7-8a66-abde29b67378-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:15:55.334346 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Lock "cinder-9f4af3ca-608e-4ac7-8a66-abde29b67378-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:15:55.521598 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:55.660369 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:15:55.660986 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Volume volume-9f4af3ca-608e-4ac7-8a66-abde29b67378 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:15:55.677255 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] deleting rbd volume volume-9f4af3ca-608e-4ac7-8a66-abde29b67378 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:15:55.884752 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-23965bfb-14df-42e8-af2f-d9456626297f req-4e031843-e5ae-4abe-9805-4ea685a82232 tempest-AttachVolumeTestJSON-1033298169 None] Terminate volume connection completed successfully.
Aug 27 21:15:55.888240 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-23965bfb-14df-42e8-af2f-d9456626297f req-4e031843-e5ae-4abe-9805-4ea685a82232 tempest-AttachVolumeTestJSON-1033298169 None] Deleting attachment 4561946e-ff6d-492a-9de5-26a2aa2f354e. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:15:56.386029 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Created reservations ['b72fd24b-909c-4b4e-87e6-db0f9a775a4f', 'a5d85d39-b6c5-4576-863e-f840c27f70cf', 'c09e6b30-b570-47ad-ba40-7b3de9be2191', '883c94de-5f76-4cd9-9633-b77abf5ebd55'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:15:56.424077 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=70,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:15:56.535118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:56.650181 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:15:56.771806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:15:56.787072 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Deleted volume successfully.
Aug 27 21:15:56.853201 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-fbcf3d5e-71f2-477f-a29f-1356bea4a764 req-5eeb739a-bdf5-4add-b2d7-dd152a60072a tempest-VolumesSnapshotsTestJSON-808827494 None] Lock "cinder-9f4af3ca-608e-4ac7-8a66-abde29b67378-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:15:57.980575 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-04419b33-744a-415e-8be3-55c54c63fe76 req-6498569c-a051-4877-b420-6255f4e40693 tempest-AttachVolumeTestJSON-1033298169 None] Terminate volume connection completed successfully.
Aug 27 21:15:57.981245 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-04419b33-744a-415e-8be3-55c54c63fe76 req-6498569c-a051-4877-b420-6255f4e40693 tempest-AttachVolumeTestJSON-1033298169 None] Deleting attachment 764f1675-be2f-444f-be6c-9c7cd2c5ad4e. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:16:02.743745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:16:02.807365 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (950fd1f0-86d5-462d-8cac-dc9d27373a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:02.832622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2251fd8f-2dda-463e-8b7a-f5f855158d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:02.884318 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:16:02.884780 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:03.013970 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:03.141766 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:03.153999 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2251fd8f-2dda-463e-8b7a-f5f855158d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757148855',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3eade37-eedd-4ab8-9c81-e9a598ec26b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49d4bb66dd3e4fffbb1433dee53141d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:16:03Z,use_quota=True,user_id='dfbad976b8094bc09b5ea872bbf770d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.176136 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dfe3f1-a53c-4eb4-8740-e92336ad908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:03.221657 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9dfe3f1-a53c-4eb4-8740-e92336ad908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.248000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f01e13e-050a-4869-acde-363aa47ad62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:03.278731 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f01e13e-050a-4869-acde-363aa47ad62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3eade37-eedd-4ab8-9c81-e9a598ec26b4', 'volume_name': 'volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.329991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a687c6-b1f3-407d-b675-0082a077bafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:03.358423 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a687c6-b1f3-407d-b675-0082a077bafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.387093 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c801791-a5f8-47f4-a555-1ead84340557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:03.388548 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Volume e3eade37-eedd-4ab8-9c81-e9a598ec26b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4', 'volume_size': 1}
Aug 27 21:16:03.388946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] creating volume 'volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:16:03.392893 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:03.605351 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:16:03.605911 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:16:03.611440 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c801791-a5f8-47f4-a555-1ead84340557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.634386 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b208b731-8f7e-4105-8a7b-f09f122b3c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:03.665783 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Volume volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4 (e3eade37-eedd-4ab8-9c81-e9a598ec26b4): created successfully
Aug 27 21:16:03.691789 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b208b731-8f7e-4105-8a7b-f09f122b3c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:03.698006 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (950fd1f0-86d5-462d-8cac-dc9d27373a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:03.715963 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-070ab68c-81d0-487e-a795-3ff6e8845de2 tempest-VolumesTestJSON-121884501 None] Created volume successfully.
Aug 27 21:16:06.081711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:16:06.163518 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (1d845021-3b82-40f4-b85d-f82cc1e3010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:06.187809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0576f5d8-ba38-424c-b6db-7c2bd85e0cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.222454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0576f5d8-ba38-424c-b6db-7c2bd85e0cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-394839864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6a9b13e1-fc0a-4dac-a452-c94aa84fae64,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49d4bb66dd3e4fffbb1433dee53141d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:16:06Z,use_quota=True,user_id='dfbad976b8094bc09b5ea872bbf770d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.237712 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e9b747-0881-46ae-97bc-c0d7bee1db9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.250027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16e9b747-0881-46ae-97bc-c0d7bee1db9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.262708 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb9835b-2e9c-43c1-b1f4-05d92ac7b123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.275488 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eb9835b-2e9c-43c1-b1f4-05d92ac7b123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9b13e1-fc0a-4dac-a452-c94aa84fae64', 'volume_name': 'volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.290374 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e0789-4235-430d-85e7-e54c6a2dd553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.300997 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081e0789-4235-430d-85e7-e54c6a2dd553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.347103 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77163676-ec58-43a3-a770-b9285146b0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.349503 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Volume 6a9b13e1-fc0a-4dac-a452-c94aa84fae64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64', 'volume_size': 1}
Aug 27 21:16:06.353248 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] creating volume 'volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:16:06.354462 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:06.502575 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:16:06.502878 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:16:06.512616 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77163676-ec58-43a3-a770-b9285146b0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.531818 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc1726a-b7ca-4fac-b8c8-3cbc887163ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:06.559970 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Volume volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64 (6a9b13e1-fc0a-4dac-a452-c94aa84fae64): created successfully
Aug 27 21:16:06.564938 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc1726a-b7ca-4fac-b8c8-3cbc887163ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:06.571027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (1d845021-3b82-40f4-b85d-f82cc1e3010f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:06.596549 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c4162796-ad3c-4b13-9b8e-0919a7a5227d tempest-VolumesTestJSON-121884501 None] Created volume successfully.
Aug 27 21:16:07.885321 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:16:07.908579 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (5635801d-462c-45de-834c-5a594eb02caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:07.916284 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76815e3-1faf-4263-9c6a-49d84a8c3823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:07.933521 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76815e3-1faf-4263-9c6a-49d84a8c3823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1409136067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=47f10a7f-58ea-4ccf-aaee-21d3100d016d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49d4bb66dd3e4fffbb1433dee53141d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:16:08Z,use_quota=True,user_id='dfbad976b8094bc09b5ea872bbf770d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:07.939591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3c0021-c7f2-45ab-b61b-27dd1598857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:07.943605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3c0021-c7f2-45ab-b61b-27dd1598857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:07.948981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a965f69-56e8-4ae3-9ecf-ab47b4c794e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:07.953337 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a965f69-56e8-4ae3-9ecf-ab47b4c794e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f10a7f-58ea-4ccf-aaee-21d3100d016d', 'volume_name': 'volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:07.958860 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc04522-8481-44cf-ab47-e6ea5e98d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:07.963374 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc04522-8481-44cf-ab47-e6ea5e98d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:07.967954 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74317a15-2bd6-4cb2-aa37-1939363172d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:07.969215 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Volume 47f10a7f-58ea-4ccf-aaee-21d3100d016d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d', 'volume_size': 1}
Aug 27 21:16:07.969773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] creating volume 'volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:16:07.970575 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:08.056909 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:16:08.057286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:16:08.060935 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74317a15-2bd6-4cb2-aa37-1939363172d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:08.065981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad73b1a-00aa-4d16-b16e-656f44f1d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:16:08.078984 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Volume volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d (47f10a7f-58ea-4ccf-aaee-21d3100d016d): created successfully
Aug 27 21:16:08.083000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad73b1a-00aa-4d16-b16e-656f44f1d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:16:08.089752 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Flow 'volume_create_manager' (5635801d-462c-45de-834c-5a594eb02caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:16:08.100322 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1265c2f7-561e-466c-8377-acfbf28bca12 tempest-VolumesTestJSON-121884501 None] Created volume successfully.
Aug 27 21:16:09.309905 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Acquiring lock "cinder-92e11cba-093d-477a-884f-674297358856-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:09.333699 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-92e11cba-093d-477a-884f-674297358856-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:09.397927 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:09.459160 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:09.459637 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-92e11cba-093d-477a-884f-674297358856 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:09.478420 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] deleting rbd volume volume-92e11cba-093d-477a-884f-674297358856 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:09.927516 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Created reservations ['6f5676f2-cbeb-4ca2-88cf-cb977dbabfb1', 'c804ee3d-7db8-44f7-a5dc-1a22af069367', 'f70d644d-2410-41f0-a0be-d14671667310', '66189bb3-de15-451a-aaa4-20d345cafe61'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:09.940398 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=69,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=7 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:16:10.014437 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:10.058255 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:10.104609 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:10.110506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Acquiring lock "cinder-47f10a7f-58ea-4ccf-aaee-21d3100d016d-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:10.115880 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Deleted volume successfully.
Aug 27 21:16:10.140883 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Lock "cinder-47f10a7f-58ea-4ccf-aaee-21d3100d016d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:10.202051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b2af2db3-5018-4a48-aadd-dd7e9fd52a31 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-92e11cba-093d-477a-884f-674297358856-delete_volume" released by "delete_volume" :: held 0.874s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:10.259299 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:10.366922 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:10.367733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Volume volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:10.385051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] deleting rbd volume volume-47f10a7f-58ea-4ccf-aaee-21d3100d016d {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:10.518356 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Acquiring lock "cinder-0181737c-e695-4334-adad-23facf867139-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:10.538602 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-0181737c-e695-4334-adad-23facf867139-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:10.639334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:10.746435 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:10.746853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-0181737c-e695-4334-adad-23facf867139 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:10.761274 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] deleting rbd volume volume-0181737c-e695-4334-adad-23facf867139 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:11.033087 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Created reservations ['e28dbb49-b93a-4dcf-ba71-1202024c3928', 'a9ddb61e-e184-4fec-b3e6-2bbfa135621a', '3199f3a4-fb46-499d-a10d-a0eb77db3591', 'ca586099-316d-4724-8342-f13093509e49'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:11.120373 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:11.175472 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:11.236045 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:11.254784 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Deleted volume successfully.
Aug 27 21:16:11.315605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-fb49c458-f7b0-4367-88fa-82b5366532ba tempest-VolumesTestJSON-121884501 None] Lock "cinder-47f10a7f-58ea-4ccf-aaee-21d3100d016d-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:11.328227 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Acquiring lock "cinder-6a9b13e1-fc0a-4dac-a452-c94aa84fae64-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:11.333561 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Created reservations ['99121484-e4f4-49b9-9bda-f0d8910880ec', 'ecca28c2-9b04-44b3-a115-dac775b79a52', '7ba530e9-2259-499b-9b30-9e603724637c', '91079223-8608-4d13-97d1-d8fad169d38c'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:11.359929 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Lock "cinder-6a9b13e1-fc0a-4dac-a452-c94aa84fae64-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:11.411705 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=56,cinder:UPDATE=34,cinder:DELETE=4,cinder:INSERT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:16:11.416084 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:11.467687 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:11.468218 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Volume volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:11.474538 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] deleting rbd volume volume-6a9b13e1-fc0a-4dac-a452-c94aa84fae64 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:11.479237 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:11.509415 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:11.553261 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:11.557588 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Deleted volume successfully.
Aug 27 21:16:11.586337 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-3ddf5ece-a319-4eb2-aa55-b0e8803c0534 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-0181737c-e695-4334-adad-23facf867139-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:11.850081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Created reservations ['9823431c-cb11-41f9-a3cb-8948fa3fe6c3', 'b15835d6-00c6-49c2-8b5a-201481bf1c05', 'ff283ec2-2aab-4fde-92f5-97c46f7195d2', '9c893e3b-d39e-4275-a9fc-43a5d97af2d7'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:11.859467 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Acquiring lock "cinder-61a807d3-b11f-43f6-965d-0da042564d73-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:11.883977 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-61a807d3-b11f-43f6-965d-0da042564d73-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:11.949310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.014091 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:12.014520 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Volume volume-61a807d3-b11f-43f6-965d-0da042564d73 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:12.023494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] deleting rbd volume volume-61a807d3-b11f-43f6-965d-0da042564d73 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:12.043533 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.105917 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.186957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:12.201859 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Deleted volume successfully.
Aug 27 21:16:12.237819 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ec01bd54-7654-4c49-9400-8f8179660f10 tempest-VolumesTestJSON-121884501 None] Lock "cinder-6a9b13e1-fc0a-4dac-a452-c94aa84fae64-delete_volume" released by "delete_volume" :: held 0.874s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:12.517159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Created reservations ['16ed2a1e-ba54-4e74-afb7-1cb72c3987a2', '3b84943c-b09a-4163-9e06-826ef0006023', '53aa7c18-8383-4c6d-b204-658d93fa2995', 'defa278a-f979-4809-940b-65634f5d24b0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:12.565980 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=57,cinder:UPDATE=35,cinder:INSERT=7,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:16:12.607689 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Acquiring lock "cinder-e3eade37-eedd-4ab8-9c81-e9a598ec26b4-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:12.624813 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Lock "cinder-e3eade37-eedd-4ab8-9c81-e9a598ec26b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:12.632219 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.709411 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.757907 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:12.780054 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Deleted volume successfully.
Aug 27 21:16:12.805140 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7d434337-ccaf-42e2-b163-a18d87c874e3 tempest-AttachVolumeTestJSON-1033298169 None] Lock "cinder-61a807d3-b11f-43f6-965d-0da042564d73-delete_volume" released by "delete_volume" :: held 0.921s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:12.809080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:12.852018 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:12.853125 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Volume volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:12.861861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] deleting rbd volume volume-e3eade37-eedd-4ab8-9c81-e9a598ec26b4 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:13.242823 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Created reservations ['32019c80-1fe8-4b59-9d0f-f6bc8780fa8a', 'a24bb9cf-1b5f-491a-9bc3-26f0e20e99d7', '914de617-22be-443f-bf59-8bef350a552c', '05474959-4c0f-403e-add8-a44fe4c337f3'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:13.352853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:13.404775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:13.450293 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:13.454393 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Deleted volume successfully.
Aug 27 21:16:13.474576 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-08492f6b-ff70-447b-8562-b74d5c19f626 tempest-VolumesTestJSON-121884501 None] Lock "cinder-e3eade37-eedd-4ab8-9c81-e9a598ec26b4-delete_volume" released by "delete_volume" :: held 0.850s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:32.657412 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Acquiring lock "cinder-7df4d62a-058f-4e7c-ac49-6e122cfad404-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:32.671589 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Lock "cinder-7df4d62a-058f-4e7c-ac49-6e122cfad404-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:32.722714 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:32.780662 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:32.781360 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Volume volume-7df4d62a-058f-4e7c-ac49-6e122cfad404 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:32.791916 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] deleting rbd volume volume-7df4d62a-058f-4e7c-ac49-6e122cfad404 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:33.045442 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Created reservations ['72aedf6d-9411-4393-9bec-dfe8a2d08457', 'a65d5661-9768-4dcd-86a2-10f4f1b7c02d', '2fef56b8-66f7-408f-bc2d-862f58b78d98', '04ba94f8-6268-4eef-be01-6d7fee692f91'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:33.099816 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:33.133025 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:33.170201 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:33.174925 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Deleted volume successfully.
Aug 27 21:16:33.189719 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bfd38e2d-c330-406a-902a-266f9b964760 tempest-ServersNegativeTestJSON-1621363259 None] Lock "cinder-7df4d62a-058f-4e7c-ac49-6e122cfad404-delete_volume" released by "delete_volume" :: held 0.518s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:33.829612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Acquiring lock "cinder-243c58b5-d48f-4f79-bb94-6ae6a0febe12-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:16:33.852242 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Lock "cinder-243c58b5-d48f-4f79-bb94-6ae6a0febe12-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:16:33.900767 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:33.950554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:16:33.950987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Volume volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:16:33.955943 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] deleting rbd volume volume-243c58b5-d48f-4f79-bb94-6ae6a0febe12 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:16:34.159228 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=53,cinder:INSERT=5,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:16:34.173062 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Created reservations ['d633fcb1-f298-44d2-80b4-b4dfa5bd3a35', '7ba7b9a4-3287-41cc-ad61-80c50fc1b075', '9571e64c-0be3-488f-99e7-5bd79671bc7b', '8a25f857-86a0-417f-a836-7b123ec8f811'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:16:34.225990 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:34.258159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:16:34.299387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:16:34.309188 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Deleted volume successfully.
Aug 27 21:16:34.323040 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0c0a2e80-796f-4ff0-8ff3-a808d583e688 tempest-ServersNegativeTestJSON-1621363259 None] Lock "cinder-243c58b5-d48f-4f79-bb94-6ae6a0febe12-delete_volume" released by "delete_volume" :: held 0.471s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:16:44.316978 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:16:51.248168 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=47,cinder:UPDATE=27,cinder:INSERT=12,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:02.561151 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:02.592844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Flow 'volume_create_manager' (7eb2d348-77c8-4115-b60e-8b9ade467550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:02.603270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed28765-6903-4442-895f-802be3fa7a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.631011 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed28765-6903-4442-895f-802be3fa7a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1886258640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bd39b830-6dd7-44ea-bb11-15a2d1f5987b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12fcf33563bb4c08852f48ad3cb2eed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:03Z,use_quota=True,user_id='3ed5b662d08e405395b930a185b78d47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.637612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bcbc7e-6ada-4ee5-b680-70e21e0dc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.642606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bcbc7e-6ada-4ee5-b680-70e21e0dc29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.649961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1cb8dc-4cc8-4c82-a58a-3274cb23fe49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.654770 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1cb8dc-4cc8-4c82-a58a-3274cb23fe49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd39b830-6dd7-44ea-bb11-15a2d1f5987b', 'volume_name': 'volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.660302 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fec812-faaa-4b2e-a0eb-9a389c1fb109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.664704 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fec812-faaa-4b2e-a0eb-9a389c1fb109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.670185 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4b7f78-947c-4e5f-811e-2074c4dcdd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.671540 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume bd39b830-6dd7-44ea-bb11-15a2d1f5987b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b', 'volume_size': 1}
Aug 27 21:17:02.672081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] creating volume 'volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:02.673040 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:02.804720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:02.806303 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:02.810811 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a4b7f78-947c-4e5f-811e-2074c4dcdd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.817788 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddf885a-1989-4ebd-8f5e-d80c57efbc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:02.844274 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b (bd39b830-6dd7-44ea-bb11-15a2d1f5987b): created successfully
Aug 27 21:17:02.850637 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddf885a-1989-4ebd-8f5e-d80c57efbc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:02.863592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Flow 'volume_create_manager' (7eb2d348-77c8-4115-b60e-8b9ade467550) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:02.879763 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:17:02.880936 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:02.979712 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:03.058181 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:03.065190 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2dcf345b-a99a-4734-9f6e-b75734aa49c7 tempest-AttachVolumeShelveTestJSON-1808861972 None] Created volume successfully.
Aug 27 21:17:15.876076 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:15.884565 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-40a68be2-b305-470f-9e7c-c9946a2c2024 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1064204117: creating
Aug 27 21:17:15.916310 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-40a68be2-b305-470f-9e7c-c9946a2c2024 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1064204117: created successfully
Aug 27 21:17:15.929049 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-40a68be2-b305-470f-9e7c-c9946a2c2024 tempest-GroupSnapshotsTest-385140469 None] Create group completed successfully.
Aug 27 21:17:17.442667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:17.469742 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (edaaaf83-5d4f-47e8-8ab1-b568c8a9430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:17.476875 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2678708-cd40-4718-aa38-0287b98a95e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.497119 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2678708-cd40-4718-aa38-0287b98a95e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-105965517',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=258fe49b-f8f5-4ec5-a6a8-76eb318f55f0,host='ncdv-master-1@ceph#ceph',id=b90767c5-f2d9-4a9f-9e09-fbc78cabc119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b838e37fb4c2f8af793745a45ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:17Z,use_quota=True,user_id='6924753eabda4a6fa9e218d49bcee371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec6d55fb-d26d-4890-b1f6-723476e0f828),volume_type_id=ec6d55fb-d26d-4890-b1f6-723476e0f828)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.502458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5651b9-9c9d-4deb-85d7-af9932f02d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.507023 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5651b9-9c9d-4deb-85d7-af9932f02d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.512068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c88de9a-a91d-4b81-97d0-ed8b0589a054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.516097 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c88de9a-a91d-4b81-97d0-ed8b0589a054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b90767c5-f2d9-4a9f-9e09-fbc78cabc119', 'volume_name': 'volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.521161 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc64c4c-1852-45e2-a762-616a8fd6e142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.525181 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc64c4c-1852-45e2-a762-616a8fd6e142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.530161 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b3664-0741-4547-b382-9cdf6f35140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.531300 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Volume b90767c5-f2d9-4a9f-9e09-fbc78cabc119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119', 'volume_size': 1}
Aug 27 21:17:17.531720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] creating volume 'volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:17.532373 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:17.604227 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:17.604604 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:17.608269 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4b3664-0741-4547-b382-9cdf6f35140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.612761 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f845a66d-9539-4982-89f7-c11092f6be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:17.624209 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Volume volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119 (b90767c5-f2d9-4a9f-9e09-fbc78cabc119): created successfully
Aug 27 21:17:17.627905 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f845a66d-9539-4982-89f7-c11092f6be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:17.634035 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (edaaaf83-5d4f-47e8-8ab1-b568c8a9430a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:17.644430 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-30eb0224-ea48-4efc-bd8b-1de9baa7edba tempest-GroupSnapshotsTest-385140469 None] Created volume successfully.
Aug 27 21:17:18.742656 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-866d015f-bb88-4af6-aab7-90543d794eab tempest-GroupSnapshotsTest-385140469 None] GroupSnapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: creating.
Aug 27 21:17:18.785957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-866d015f-bb88-4af6-aab7-90543d794eab tempest-GroupSnapshotsTest-385140469 None] Group snapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: creating. {{(pid=133391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Aug 27 21:17:18.804311 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-866d015f-bb88-4af6-aab7-90543d794eab tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:19.066574 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-866d015f-bb88-4af6-aab7-90543d794eab tempest-GroupSnapshotsTest-385140469 None] group_snapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: created successfully
Aug 27 21:17:19.940587 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:19.962052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Flow 'volume_create_manager' (021cb0c2-96cd-40ff-986b-78ec01fa17d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:19.968569 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98d8f8e-e055-4e80-b840-6911f003eb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:19.986158 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b98d8f8e-e055-4e80-b840-6911f003eb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-993433219',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b6a58a1-6266-49ee-9141-7fcd355f359c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda9a5a7acd44ab4a39e244ee4e98629',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:20Z,use_quota=True,user_id='5545f455d67b4119b970f239d7dd3053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:19.991955 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e20743-538e-4a5a-a6fc-6bb085d7b7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:19.996732 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39e20743-538e-4a5a-a6fc-6bb085d7b7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:20.002016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c1b04a-2094-4738-9dfd-09456271f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:20.006405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c1b04a-2094-4738-9dfd-09456271f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b6a58a1-6266-49ee-9141-7fcd355f359c', 'volume_name': 'volume-9b6a58a1-6266-49ee-9141-7fcd355f359c', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:20.011419 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed49febc-bcd8-42b6-8f54-701558830863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:20.015805 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed49febc-bcd8-42b6-8f54-701558830863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:20.021034 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e91f6-8c42-46e2-ad7c-8b6113d49623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:20.022313 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Volume 9b6a58a1-6266-49ee-9141-7fcd355f359c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b6a58a1-6266-49ee-9141-7fcd355f359c', 'volume_size': 1}
Aug 27 21:17:20.022842 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] creating volume 'volume-9b6a58a1-6266-49ee-9141-7fcd355f359c' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:20.024115 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:20.113167 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:20.114249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:20.119838 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837e91f6-8c42-46e2-ad7c-8b6113d49623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6a58a1-6266-49ee-9141-7fcd355f359c', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:20.126840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160add1c-6834-45de-ab53-e97365c92b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:20.142219 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Volume volume-9b6a58a1-6266-49ee-9141-7fcd355f359c (9b6a58a1-6266-49ee-9141-7fcd355f359c): created successfully
Aug 27 21:17:20.147790 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160add1c-6834-45de-ab53-e97365c92b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:20.154499 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Flow 'volume_create_manager' (021cb0c2-96cd-40ff-986b-78ec01fa17d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:20.164567 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9492ca6f-3850-48ae-97a4-c32ad3eeb0de tempest-VolumesBackupsV39Test-419477231 None] Created volume successfully.
Aug 27 21:17:20.628560 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] cloning volumes/volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119@snapshot-35adec5b-c501-41ed-995f-340e1cfe9c7e to volume-23cdb05d-cbfd-41bc-9bdd-e6b7674bb6fc {{(pid=133391) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Aug 27 21:17:20.629222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:20.675758 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:20.820345 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:20.825118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:20.842145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:20.917502 ncdv-master-1 cinder-volume[133391]: WARNING cinder.volume.drivers.rbd [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError
Aug 27 21:17:21.029310 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-bceef415-dab4-43c4-bb8b-65c952b39324 tempest-GroupSnapshotsTest-385140469 None] Create group from source-snapshot-4f8a4135-8bcc-4760-8060-18554dd984ec completed successfully.
Aug 27 21:17:21.296606 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=44,cinder:UPDATE=11,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:21.309385 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-27T21:17:21Z,data_timestamp=2022-08-27T21:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Backup-1886885845',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=501dc7dd-457c-46fb-a7ff-59f6cae49c15,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='eda9a5a7acd44ab4a39e244ee4e98629',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='5545f455d67b4119b970f239d7dd3053',volume_id=9b6a58a1-6266-49ee-9141-7fcd355f359c)
Aug 27 21:17:21.329958 ncdv-master-1 cinder-volume[133391]: INFO cinder.rpc [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Aug 27 21:17:21.339635 ncdv-master-1 cinder-volume[133391]: INFO cinder.rpc [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Aug 27 21:17:21.341775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.backup.rpcapi [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] continue_backup in rpcapi backup_id 501dc7dd-457c-46fb-a7ff-59f6cae49c15 {{(pid=133391) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 27 21:17:22.167105 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:22.237285 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:17:22.244241 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] deleting rbd volume volume-23cdb05d-cbfd-41bc-9bdd-e6b7674bb6fc {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:22.437515 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['38332d1e-e6ba-4e91-a612-5d6228eab3d3'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:22.455737 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1771217491 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1771217491, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:22.456533 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1771217491 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1771217491, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:22.472703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['d2853fe1-e408-4743-8136-0526aae36b66', 'b3bb96eb-2f27-44e8-9c61-866b78acaa32', '04f0e36e-2728-4e78-bc75-8c7612eca95a', '21349c27-2acc-482f-aa14-ae9c00b9c892'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:22.567433 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:22.617453 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:22.664722 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:22.669545 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c02434ac-854f-4317-a0f5-7b916e19deb8 tempest-GroupSnapshotsTest-385140469 None] Delete group completed successfully.
Aug 27 21:17:23.357662 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] group_snapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: deleting
Aug 27 21:17:23.376882 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] group_snapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: deleting {{(pid=133391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Aug 27 21:17:23.397603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:24.128268 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1771217491 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1771217491, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:24.165836 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['5037e042-050a-4467-bb55-a6745b33e65f', 'c1c5cc0b-c176-4d8f-b4ac-aca49bb937e0', 'e383030c-becb-4359-9cda-5dd4301b162e', '9ceee262-7517-4dd9-a4a9-5aa54f2abbdd'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:24.227914 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8f8ab2d3-a41f-4f80-8920-72ade5aa72e5 tempest-GroupSnapshotsTest-385140469 None] group_snapshot 4f8a4135-8bcc-4760-8060-18554dd984ec: deleted successfully
Aug 27 21:17:24.889869 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=71,cinder:UPDATE=23,cinder:INSERT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:24.916532 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:24.983613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:17:24.984422 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Volume volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:17:24.989670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] deleting rbd volume volume-b90767c5-f2d9-4a9f-9e09-fbc78cabc119 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:25.368891 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Created reservations ['875827cc-9b16-41ed-b1ad-809bb9da016e'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:25.469857 ncdv-master-1 cinder-volume[133391]: WARNING cinder.db.sqlalchemy.api [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1771217491']
Aug 27 21:17:25.481388 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Created reservations ['3c059964-4d33-4a00-ae7b-f0a09f69ae27', 'b05d2986-2bba-4308-b94e-7d4682b2a3d3', '1eadec0c-0d9e-42b5-979d-f2273a2b59df', 'bb1317f2-cfc0-4631-afe3-19aac7c03422'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:25.625731 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:25.695625 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:25.749473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:25.764372 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6d668f50-b726-44b1-b73c-9a3e8fd7d60d tempest-GroupSnapshotsTest-385140469 None] Delete group completed successfully.
Aug 27 21:17:26.465246 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b1157698-5c22-4ff5-9b96-8093f42e8242 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1584180950: creating
Aug 27 21:17:26.489506 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b1157698-5c22-4ff5-9b96-8093f42e8242 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1584180950: created successfully
Aug 27 21:17:26.500106 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b1157698-5c22-4ff5-9b96-8093f42e8242 tempest-GroupSnapshotsTest-385140469 None] Create group completed successfully.
Aug 27 21:17:28.163786 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=67,cinder:UPDATE=29,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:28.201963 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:28.289460 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (1243a9af-c73b-41ac-8292-8a55fdf7a9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:28.310186 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ce2e8-dedc-40c6-985e-de04a024dc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.364622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c6ce2e8-dedc-40c6-985e-de04a024dc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1201105644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05e8a51d-a10a-4c77-9e78-bdadc650bc76,host='ncdv-master-1@ceph#ceph',id=11234f50-20f0-4074-a83d-55d512296c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b838e37fb4c2f8af793745a45ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:28Z,use_quota=True,user_id='6924753eabda4a6fa9e218d49bcee371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb562598-1169-4fd2-98af-1df9da2e9053),volume_type_id=cb562598-1169-4fd2-98af-1df9da2e9053)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.374985 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fa8179-ebd7-4c2e-af5e-70d7ba311279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.388869 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1fa8179-ebd7-4c2e-af5e-70d7ba311279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.399463 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cac5eca-d807-4d5d-b639-f6e44c0b93f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.405910 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cac5eca-d807-4d5d-b639-f6e44c0b93f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11234f50-20f0-4074-a83d-55d512296c4f', 'volume_name': 'volume-11234f50-20f0-4074-a83d-55d512296c4f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.431805 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd08e2-7be4-4918-ba95-c26eb459d32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.444064 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dd08e2-7be4-4918-ba95-c26eb459d32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.449127 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbca473-f9df-4722-922f-2203a1d9a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.453950 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Volume 11234f50-20f0-4074-a83d-55d512296c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11234f50-20f0-4074-a83d-55d512296c4f', 'volume_size': 1}
Aug 27 21:17:28.454760 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] creating volume 'volume-11234f50-20f0-4074-a83d-55d512296c4f' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:28.457401 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:28.647149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:28.647632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:28.652561 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dbca473-f9df-4722-922f-2203a1d9a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11234f50-20f0-4074-a83d-55d512296c4f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.658389 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d0925-f758-4cc0-b802-0252bc8ff37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:28.682805 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Volume volume-11234f50-20f0-4074-a83d-55d512296c4f (11234f50-20f0-4074-a83d-55d512296c4f): created successfully
Aug 27 21:17:28.698951 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (319d0925-f758-4cc0-b802-0252bc8ff37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:28.720755 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (1243a9af-c73b-41ac-8292-8a55fdf7a9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:28.753778 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-33fada3e-dc50-420f-b93d-39b1756eb08c tempest-GroupSnapshotsTest-385140469 None] Created volume successfully.
Aug 27 21:17:29.579893 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:17:30.221727 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:30.261208 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (286ac667-50b2-48bc-8fed-bc72be3a5b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:30.279153 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1ce1e9-d6e9-41fd-ab1b-7993610e2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.317680 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1ce1e9-d6e9-41fd-ab1b-7993610e2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-155934005',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=05e8a51d-a10a-4c77-9e78-bdadc650bc76,host='ncdv-master-1@ceph#ceph',id=a3c24ee7-18a4-4335-b171-c9438570917f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b838e37fb4c2f8af793745a45ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:30Z,use_quota=True,user_id='6924753eabda4a6fa9e218d49bcee371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb562598-1169-4fd2-98af-1df9da2e9053),volume_type_id=cb562598-1169-4fd2-98af-1df9da2e9053)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.332532 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faa5225-1a94-4131-ada3-386503c2cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.344344 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6faa5225-1a94-4131-ada3-386503c2cc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.353368 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e9968-7f57-4101-9005-b72155b85643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.368216 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827e9968-7f57-4101-9005-b72155b85643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c24ee7-18a4-4335-b171-c9438570917f', 'volume_name': 'volume-a3c24ee7-18a4-4335-b171-c9438570917f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.373464 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29828b64-8ba1-43e4-9748-52a4a6717aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.386720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29828b64-8ba1-43e4-9748-52a4a6717aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.409274 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf33859-27d6-4537-b4cf-a88db2e091f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.421769 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Volume a3c24ee7-18a4-4335-b171-c9438570917f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c24ee7-18a4-4335-b171-c9438570917f', 'volume_size': 1}
Aug 27 21:17:30.422639 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] creating volume 'volume-a3c24ee7-18a4-4335-b171-c9438570917f' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:30.425088 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:30.570885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:30.572406 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:30.576653 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf33859-27d6-4537-b4cf-a88db2e091f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c24ee7-18a4-4335-b171-c9438570917f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.595661 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bdf959-6370-4b55-a864-4ff66ce5ef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:30.632784 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Volume volume-a3c24ee7-18a4-4335-b171-c9438570917f (a3c24ee7-18a4-4335-b171-c9438570917f): created successfully
Aug 27 21:17:30.639613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16bdf959-6370-4b55-a864-4ff66ce5ef2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:30.647270 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (286ac667-50b2-48bc-8fed-bc72be3a5b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:30.671205 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-47c63755-48b3-4c3d-a2e1-74f587863814 tempest-GroupSnapshotsTest-385140469 None] Created volume successfully.
Aug 27 21:17:31.063962 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.484s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:17:31.065066 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9b6a58a1-6266-49ee-9141-7fcd355f359c', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '9b6a58a1-6266-49ee-9141-7fcd355f359c', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:17:31.082941 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Initialize volume connection completed successfully.
Aug 27 21:17:31.732972 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-233050bc-c7e6-48df-b49b-5897c2f70b63 tempest-GroupSnapshotsTest-385140469 None] Update group completed successfully.
Aug 27 21:17:33.067958 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4cb7eadd-99a7-45aa-9406-41f3f2651ea3 tempest-GroupSnapshotsTest-385140469 None] Update group completed successfully.
Aug 27 21:17:34.316553 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1382624a-da60-4acd-b616-a42b83029b40 tempest-GroupSnapshotsTest-385140469 None] Update group completed successfully.
Aug 27 21:17:35.364881 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Terminate volume connection completed successfully.
Aug 27 21:17:35.398640 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-15a7752a-183f-4afe-beda-fd0abe2baee3 tempest-VolumesBackupsV39Test-419477231 None] Remove volume export completed successfully.
Aug 27 21:17:35.704159 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4183bc33-31f3-4252-8567-2aa59816e82f tempest-GroupSnapshotsTest-385140469 None] Update group completed successfully.
Aug 27 21:17:37.647088 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d9c898b3-1f9b-40f7-8d42-e601f1595005 tempest-GroupSnapshotsTest-385140469 None] GroupSnapshot e374771c-02d5-479c-8140-ba1b9a517b99: creating.
Aug 27 21:17:37.724785 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d9c898b3-1f9b-40f7-8d42-e601f1595005 tempest-GroupSnapshotsTest-385140469 None] Group snapshot e374771c-02d5-479c-8140-ba1b9a517b99: creating. {{(pid=133391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Aug 27 21:17:37.775569 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d9c898b3-1f9b-40f7-8d42-e601f1595005 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:38.254188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d9c898b3-1f9b-40f7-8d42-e601f1595005 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:38.371024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Acquiring lock "cinder-9b6a58a1-6266-49ee-9141-7fcd355f359c-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:17:38.407425 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Lock "cinder-9b6a58a1-6266-49ee-9141-7fcd355f359c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:17:38.482668 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:39.232964 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Volume volume-9b6a58a1-6266-49ee-9141-7fcd355f359c is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:17:39.264556 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] deleting rbd volume volume-9b6a58a1-6266-49ee-9141-7fcd355f359c {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:39.503758 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d9c898b3-1f9b-40f7-8d42-e601f1595005 tempest-GroupSnapshotsTest-385140469 None] group_snapshot e374771c-02d5-479c-8140-ba1b9a517b99: created successfully
Aug 27 21:17:39.507752 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=73,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:39.743867 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Created reservations ['e909bb8b-8b34-4553-b6ee-aa467ee0cd6e', '1929b612-d588-4b89-ad09-1bf8569c4e56', 'dbab723c-919e-4251-b099-577c247bf80f', 'eb09b429-ab9c-486e-8797-e11472e1b1a7'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:39.859641 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:39.959631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:40.046770 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:40.057905 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Deleted volume successfully.
Aug 27 21:17:40.081480 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cf64496d-6896-4732-9232-15d37640688d tempest-VolumesBackupsV39Test-419477231 None] Lock "cinder-9b6a58a1-6266-49ee-9141-7fcd355f359c-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:17:40.142295 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] group_snapshot e374771c-02d5-479c-8140-ba1b9a517b99: deleting
Aug 27 21:17:40.200032 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] group_snapshot e374771c-02d5-479c-8140-ba1b9a517b99: deleting {{(pid=133391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Aug 27 21:17:40.267239 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:41.353725 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:42.200506 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-618010134 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-618010134, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:42.201683 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-618010134 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-618010134, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:42.229640 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['b8efdba8-894d-4813-aaa2-12e34c68b42a', '3ecc2d5f-b264-46cd-962e-09d6ec9089ee', 'e83fbd67-7f42-4f97-a813-3a2c796732a1', 'c1f2dac3-9b56-4f94-9dee-d117e1542811'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:42.308048 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:42.394756 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['8d3640a7-2d8e-4efb-af4a-599249c04bc9', '545a5cb9-74cf-46e1-b53f-abcee65d2bce', 'f2063672-3061-4ed3-a8c8-b8d1dac7bd54', '5e66b98d-34dc-442e-9340-e6a0bc81bc2c'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:42.477043 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca7b507c-0f80-4f50-8ec1-9bcbf8a27558 tempest-GroupSnapshotsTest-385140469 None] group_snapshot e374771c-02d5-479c-8140-ba1b9a517b99: deleted successfully
Aug 27 21:17:43.510946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:43.637052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:17:43.637503 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Volume volume-11234f50-20f0-4074-a83d-55d512296c4f is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:17:43.660016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] deleting rbd volume volume-11234f50-20f0-4074-a83d-55d512296c4f {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:44.021620 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:44.092484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:17:44.093053 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Volume volume-a3c24ee7-18a4-4335-b171-c9438570917f is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:17:44.113021 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] deleting rbd volume volume-a3c24ee7-18a4-4335-b171-c9438570917f {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:44.521486 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['9335e376-e139-4379-b086-7b3252aadba6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:44.549006 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-618010134 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-618010134, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:44.572602 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['0685420c-b918-469d-b539-9a5bb2e78667', 'c31aee80-cf11-4cb7-b26c-daca89bbceb4', '4d509b74-3fea-4a0c-a789-1129d3d64420', 'b3beb4bb-08f1-41ca-8f8e-90cd1eb69589'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:44.806634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['7377215e-6fc6-4661-80a5-e442e6f52555', '175422a7-ef90-407f-932a-d37a14862c31', 'd765ac2c-64d2-4a57-b0f1-9ac7807b0165', '66c0f714-329d-416d-9856-9ad297f81e79'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:44.818597 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=59,cinder:INSERT=7,cinder:UPDATE=34 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:45.004680 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:45.097065 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:45.181476 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:45.192130 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-59569cc0-e1bf-4e7d-b173-03d70d5ce3c1 tempest-GroupSnapshotsTest-385140469 None] Delete group completed successfully.
Aug 27 21:17:46.365833 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b929debc-4a22-4528-b943-88dd64e26d13 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1769456251: creating
Aug 27 21:17:46.413491 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b929debc-4a22-4528-b943-88dd64e26d13 tempest-GroupSnapshotsTest-385140469 None] Group tempest-GroupSnapshotsTest-Group-1769456251: created successfully
Aug 27 21:17:46.436582 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b929debc-4a22-4528-b943-88dd64e26d13 tempest-GroupSnapshotsTest-385140469 None] Create group completed successfully.
Aug 27 21:17:48.144300 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:17:48.220063 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (2a76a352-7d09-4c84-8846-7b89092894e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:48.233964 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3afb2a-c413-44a2-abb6-6fc3a63d10c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.275118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa3afb2a-c413-44a2-abb6-6fc3a63d10c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:17:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-2074557647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=636ee843-4536-45fb-86ff-809582e8e426,host='ncdv-master-1@ceph#ceph',id=61444d23-7702-4f98-b4d6-fe0c84f7b82e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a2b838e37fb4c2f8af793745a45ac80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:17:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:17:48Z,use_quota=True,user_id='6924753eabda4a6fa9e218d49bcee371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0dcadff-3246-4e50-98b6-7ae4c6b8b2c9),volume_type_id=c0dcadff-3246-4e50-98b6-7ae4c6b8b2c9)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.280503 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cc4d44-267c-411e-99f0-806fe25d2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.293148 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07cc4d44-267c-411e-99f0-806fe25d2db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.342812 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cbb673-5a99-4083-ae89-df616d0cf270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.350550 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cbb673-5a99-4083-ae89-df616d0cf270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61444d23-7702-4f98-b4d6-fe0c84f7b82e', 'volume_name': 'volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.358474 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65cfb69-36bf-4dbf-878c-7452638908c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.363634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65cfb69-36bf-4dbf-878c-7452638908c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.372123 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f32eef-b6f3-4546-985b-1ac6201d194d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.374710 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Volume 61444d23-7702-4f98-b4d6-fe0c84f7b82e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e', 'volume_size': 1}
Aug 27 21:17:48.375333 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] creating volume 'volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:17:48.376599 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:48.526926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:17:48.527571 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:17:48.532168 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9f32eef-b6f3-4546-985b-1ac6201d194d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.537566 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8678bb5b-f0fd-446c-8db0-5cb5431e97af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:17:48.566483 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Volume volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e (61444d23-7702-4f98-b4d6-fe0c84f7b82e): created successfully
Aug 27 21:17:48.571307 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8678bb5b-f0fd-446c-8db0-5cb5431e97af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:17:48.578238 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Flow 'volume_create_manager' (2a76a352-7d09-4c84-8846-7b89092894e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:17:48.646198 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-923686e4-8784-4762-a6d1-525a9697a847 tempest-GroupSnapshotsTest-385140469 None] Created volume successfully.
Aug 27 21:17:49.136458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-74690c7c-ef7c-4100-b8db-304afd1e57de req-3faac4de-c9f4-4909-afaf-cc3397b4adb2 tempest-AttachVolumeShelveTestJSON-1808861972 None] No connector for attachment 0a4d4df7-5dad-4e0f-86bb-88f83ac44e5b; skipping storage backend terminate_connection call. {{(pid=133391) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}}
Aug 27 21:17:49.142579 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-74690c7c-ef7c-4100-b8db-304afd1e57de req-3faac4de-c9f4-4909-afaf-cc3397b4adb2 tempest-AttachVolumeShelveTestJSON-1808861972 None] Deleting attachment 0a4d4df7-5dad-4e0f-86bb-88f83ac44e5b. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:17:49.580666 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-28869282-85db-40c2-9ce2-3a3bf53fdbbf tempest-GroupSnapshotsTest-385140469 None] GroupSnapshot cb2681cc-1e77-43d1-91a7-82450076e497: creating.
Aug 27 21:17:49.616061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-28869282-85db-40c2-9ce2-3a3bf53fdbbf tempest-GroupSnapshotsTest-385140469 None] Group snapshot cb2681cc-1e77-43d1-91a7-82450076e497: creating. {{(pid=133391) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Aug 27 21:17:49.661253 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-28869282-85db-40c2-9ce2-3a3bf53fdbbf tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:50.657190 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-28869282-85db-40c2-9ce2-3a3bf53fdbbf tempest-GroupSnapshotsTest-385140469 None] group_snapshot cb2681cc-1e77-43d1-91a7-82450076e497: created successfully
Aug 27 21:17:51.013587 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] group_snapshot cb2681cc-1e77-43d1-91a7-82450076e497: deleting
Aug 27 21:17:51.050549 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] group_snapshot cb2681cc-1e77-43d1-91a7-82450076e497: deleting {{(pid=133391) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Aug 27 21:17:51.092213 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:51.582020 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=63,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:17:51.632982 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-220355661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-220355661, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:51.634010 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-220355661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-220355661, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:51.664118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] Created reservations ['b64ea55e-3a1d-46ae-a09b-f9d5ee62267e', 'e640191f-61c2-4947-acef-67d232613573', '07f17e29-8f1c-4f5d-b252-608467d26efe', '6990f48a-f4e8-43c4-a7bc-1acf9c895f9f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:51.779788 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-87538062-c585-4151-aafb-9ffa621e3dd9 tempest-GroupSnapshotsTest-385140469 None] group_snapshot cb2681cc-1e77-43d1-91a7-82450076e497: deleted successfully
Aug 27 21:17:52.976047 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:53.094839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:17:53.095926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Volume volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:17:53.117290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] deleting rbd volume volume-61444d23-7702-4f98-b4d6-fe0c84f7b82e {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:17:53.596655 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Created reservations ['f32b69f2-9815-4e32-afc0-d0af86a0b7e8'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:53.628167 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-220355661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-220355661, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:17:53.647465 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Created reservations ['7403e9a3-3434-40c1-892c-1681e54bef42', 'a31899e2-f34a-4bbf-ba4b-85ec23e11a9f', 'b2314108-966b-4884-8133-1867766fbcfc', '15800ccd-5748-4581-9077-878188c85b4f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:17:53.824322 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:53.871289 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:17:53.937155 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:17:53.942667 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4f6a6825-d35a-40ad-91c1-294fedbe510a tempest-GroupSnapshotsTest-385140469 None] Delete group completed successfully.
Aug 27 21:18:02.876284 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:18:02.877749 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:02.970199 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:03.057061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:18:04.150202 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-952e3002-cb1c-4365-82c7-28d75103cd5c tempest-GroupsV320Test-690079623 None] Group tempest-GroupsV320Test-Group-1394311640: creating
Aug 27 21:18:04.157687 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=66,cinder:UPDATE=30,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:18:04.270471 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-952e3002-cb1c-4365-82c7-28d75103cd5c tempest-GroupsV320Test-690079623 None] Group tempest-GroupsV320Test-Group-1394311640: created successfully
Aug 27 21:18:04.321161 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-952e3002-cb1c-4365-82c7-28d75103cd5c tempest-GroupsV320Test-690079623 None] Create group completed successfully.
Aug 27 21:18:06.251183 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0e81d4d5-f5be-4b41-8f4d-49b9c9743a3f tempest-GroupsV320Test-690079623 None] Created reservations ['92d87da5-e8d6-449d-aa74-93a79b98f319'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:18:06.380614 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0e81d4d5-f5be-4b41-8f4d-49b9c9743a3f tempest-GroupsV320Test-690079623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:06.502636 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0e81d4d5-f5be-4b41-8f4d-49b9c9743a3f tempest-GroupsV320Test-690079623 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:06.619265 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0e81d4d5-f5be-4b41-8f4d-49b9c9743a3f tempest-GroupsV320Test-690079623 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:18:06.635029 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0e81d4d5-f5be-4b41-8f4d-49b9c9743a3f tempest-GroupsV320Test-690079623 None] Delete group completed successfully.
Aug 27 21:18:21.273004 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=39,cinder:INSERT=6,cinder:UPDATE=20 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:18:26.026726 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:18:26.054104 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Flow 'volume_create_manager' (a2565490-af9d-4cb0-83d3-7fa01120d90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:26.060997 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6822ba3e-841c-4247-ab68-bcee02378fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.079735 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6822ba3e-841c-4247-ab68-bcee02378fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-973204060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=999da4b4-7c7e-4df0-9f96-115b9ffbf4a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d352758d6d645ebbd957bf2f0d36f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:18:26Z,use_quota=True,user_id='9e3b56d12e8e4e1cb76b9c8d1726525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.087928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29b6c5-5446-44a2-b377-e4af1343b026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.092376 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e29b6c5-5446-44a2-b377-e4af1343b026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.097567 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ca2b7-c5c3-4be5-ae9c-019d79872eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.102083 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b7ca2b7-c5c3-4be5-ae9c-019d79872eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '999da4b4-7c7e-4df0-9f96-115b9ffbf4a9', 'volume_name': 'volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.107030 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbcf460-fa93-45d6-a329-b7be8aa8e2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.111012 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbcf460-fa93-45d6-a329-b7be8aa8e2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.116123 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00ebd79-6652-40d8-b881-99acedeed39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.117232 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume 999da4b4-7c7e-4df0-9f96-115b9ffbf4a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9', 'volume_size': 1}
Aug 27 21:18:26.117632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] creating volume 'volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:18:26.118411 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:26.208800 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:18:26.209461 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:18:26.214498 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00ebd79-6652-40d8-b881-99acedeed39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.224646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3983b6ea-5a24-4276-8b07-3c56701a00b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:26.236490 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9 (999da4b4-7c7e-4df0-9f96-115b9ffbf4a9): created successfully
Aug 27 21:18:26.241413 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3983b6ea-5a24-4276-8b07-3c56701a00b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:26.247142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Flow 'volume_create_manager' (a2565490-af9d-4cb0-83d3-7fa01120d90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:26.258017 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-060dd6a1-4e12-40d8-8c64-937b7ad6f065 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Created volume successfully.
Aug 27 21:18:27.291620 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Acquiring lock "cinder-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:18:27.317234 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Lock "cinder-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:18:27.390545 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:27.451698 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:18:27.452259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:18:27.459323 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] deleting rbd volume volume-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:18:27.903441 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Created reservations ['8e122f13-56f1-4605-ada7-3b23043e6a5c', '3f0fddc5-f16a-4fc6-97ca-ca22bb871591', 'f0f97209-01e2-47a0-8434-cece8aac2c35', 'b29934d7-007d-4aa6-9df9-29a1ca13bd64'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:18:27.994075 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:28.060499 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:28.142751 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:18:28.146234 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Deleted volume successfully.
Aug 27 21:18:28.166081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a4923827-6948-4ec4-adef-e5b74454a842 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Lock "cinder-999da4b4-7c7e-4df0-9f96-115b9ffbf4a9-delete_volume" released by "delete_volume" :: held 0.850s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:18:29.153381 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:18:29.216525 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Flow 'volume_create_manager' (28c7c458-cec3-4229-827d-3fc42a52368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:29.235877 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df59093-3721-4937-803b-c797a895e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.270080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df59093-3721-4937-803b-c797a895e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-224327906',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4de98307-f834-4d0c-8745-5be80039ab89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d352758d6d645ebbd957bf2f0d36f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:18:29Z,use_quota=True,user_id='9e3b56d12e8e4e1cb76b9c8d1726525d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.277441 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08215d77-4544-431f-b92d-97c09e3977e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.283114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08215d77-4544-431f-b92d-97c09e3977e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.289721 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f09b02-d156-4118-99cc-7bc8926694da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.294503 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49f09b02-d156-4118-99cc-7bc8926694da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de98307-f834-4d0c-8745-5be80039ab89', 'volume_name': 'volume-4de98307-f834-4d0c-8745-5be80039ab89', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.300305 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ea63e7-7154-4b80-b735-96c24c936049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.323674 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ea63e7-7154-4b80-b735-96c24c936049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.329057 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae08e19-6efc-4217-bfa4-314d8135f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.331243 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume 4de98307-f834-4d0c-8745-5be80039ab89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de98307-f834-4d0c-8745-5be80039ab89', 'volume_size': 1}
Aug 27 21:18:29.331974 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] creating volume 'volume-4de98307-f834-4d0c-8745-5be80039ab89' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:18:29.332981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:29.492638 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:18:29.492987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:18:29.496862 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aae08e19-6efc-4217-bfa4-314d8135f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de98307-f834-4d0c-8745-5be80039ab89', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.501606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999e0afe-8471-429d-97e4-61b186f35d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:29.540611 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Volume volume-4de98307-f834-4d0c-8745-5be80039ab89 (4de98307-f834-4d0c-8745-5be80039ab89): created successfully
Aug 27 21:18:29.546512 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999e0afe-8471-429d-97e4-61b186f35d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:29.568033 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Flow 'volume_create_manager' (28c7c458-cec3-4229-827d-3fc42a52368b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:29.654510 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-50da337e-20f6-4b29-aedf-5c515afc9f61 tempest-VolumeQuotasAdminTestJSON-2052529081 None] Created volume successfully.
Aug 27 21:18:31.435838 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-57aaaa9d-88a8-4781-8181-5fd1281e7d76 tempest-VolumeQuotasAdminTestJSON-1292258309 None] Transfer volume completed successfully.
Aug 27 21:18:32.051286 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Acquiring lock "cinder-4de98307-f834-4d0c-8745-5be80039ab89-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:18:32.071769 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Lock "cinder-4de98307-f834-4d0c-8745-5be80039ab89-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:18:32.107857 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:32.227408 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:18:32.228774 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Volume volume-4de98307-f834-4d0c-8745-5be80039ab89 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:18:32.237849 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] deleting rbd volume volume-4de98307-f834-4d0c-8745-5be80039ab89 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:18:32.590146 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Created reservations ['0d184be9-7194-4aca-8c29-841dfa5141d2', '0bf66bd9-4bfa-40d4-be6e-8835a35ad082', '7eac5916-27da-49af-a27c-10fdba04dca1', 'db648f9a-49fb-4faf-8c18-e34835800490'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:18:32.680072 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:32.793019 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:32.883603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:18:32.891405 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Deleted volume successfully.
Aug 27 21:18:32.925570 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f7936ada-a7e3-4caf-b10a-92049319fd26 tempest-VolumeQuotasAdminTestJSON-971198855 None] Lock "cinder-4de98307-f834-4d0c-8745-5be80039ab89-delete_volume" released by "delete_volume" :: held 0.854s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:18:42.598553 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=62,cinder:UPDATE=29,cinder:INSERT=3,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:18:42.615769 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:18:42.641949 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Flow 'volume_create_manager' (689dba5c-938d-448c-853d-c73d4b2e7ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:42.649171 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9ca8e-aec8-4a48-8505-701d835c6bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.673158 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9ca8e-aec8-4a48-8505-701d835c6bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1734160716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0ed60cb-e8cb-495f-8b4f-084167ed7047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cd753d5ffee4d359e75f0f7919b8da0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:18:43Z,use_quota=True,user_id='8dda6166374b4e41ab818a6120188ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.683186 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8e073-1e63-470d-b1d6-6c3fc5f93ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.690506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8e073-1e63-470d-b1d6-6c3fc5f93ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.696117 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe5d3d-0ff2-4a9a-a410-d9bf09d14765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.700421 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ffe5d3d-0ff2-4a9a-a410-d9bf09d14765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ed60cb-e8cb-495f-8b4f-084167ed7047', 'volume_name': 'volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.705753 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3c40b5-6815-4743-a849-74319da0a34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.710171 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3c40b5-6815-4743-a849-74319da0a34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.716997 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c9d516-41f6-478a-a203-e286d9780d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.719075 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Volume c0ed60cb-e8cb-495f-8b4f-084167ed7047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047', 'volume_size': 1}
Aug 27 21:18:42.719784 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] creating volume 'volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:18:42.720839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:42.825663 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:18:42.826382 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:18:42.831147 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c9d516-41f6-478a-a203-e286d9780d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.836961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab99a62e-7e44-42b3-95c4-d6eccaea9477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:42.847632 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Volume volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047 (c0ed60cb-e8cb-495f-8b4f-084167ed7047): created successfully
Aug 27 21:18:42.855408 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab99a62e-7e44-42b3-95c4-d6eccaea9477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:42.862242 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Flow 'volume_create_manager' (689dba5c-938d-448c-853d-c73d4b2e7ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:42.871537 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6e6c7a68-e768-4fd8-83d7-3da28fe56eaa tempest-VolumeQuotasNegativeTestJSON-32421226 None] Created volume successfully.
Aug 27 21:18:44.804155 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Acquiring lock "cinder-c0ed60cb-e8cb-495f-8b4f-084167ed7047-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:18:44.817557 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Lock "cinder-c0ed60cb-e8cb-495f-8b4f-084167ed7047-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:18:44.879945 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:44.976365 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:18:44.977044 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Volume volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:18:44.984457 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] deleting rbd volume volume-c0ed60cb-e8cb-495f-8b4f-084167ed7047 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:18:45.289264 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Created reservations ['48ee0c04-a0f0-4b57-a9d8-015cb56382ce', '1ea618a1-c1a7-4d82-9778-84cf9d783663', 'afef0f7a-aa1d-4d82-b66f-379bfe0787d6', '31f7dd87-54a6-4e85-b464-7604423c23e6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:18:45.363191 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:45.415590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:45.473992 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:18:45.480057 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Deleted volume successfully.
Aug 27 21:18:45.497639 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8bd0722a-06f6-48f8-ad04-771d9094bda6 tempest-VolumeQuotasNegativeTestJSON-32421226 None] Lock "cinder-c0ed60cb-e8cb-495f-8b4f-084167ed7047-delete_volume" released by "delete_volume" :: held 0.680s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:18:55.357794 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=12,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:18:56.167800 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=50,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=8 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:18:56.178615 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:18:56.197349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (fc31e917-6123-4906-b566-1a6244ffdc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:56.204205 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e2dcf5-fa9b-4d09-b695-cf081b488d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.227628 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e2dcf5-fa9b-4d09-b695-cf081b488d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:18:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1363795048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fa45f468-2230-4ba2-b839-e151f9f93971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ec2f76215f4427a2158434b721dbfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:18:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:18:56Z,use_quota=True,user_id='a9ca761e029947a1ab18e357242a2838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.233115 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55513e0b-e2e0-47fe-8c44-6060f00d8651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.237631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55513e0b-e2e0-47fe-8c44-6060f00d8651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.243219 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ef7eb5-61aa-4817-9b92-9bc0ca5f5f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.247419 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3ef7eb5-61aa-4817-9b92-9bc0ca5f5f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa45f468-2230-4ba2-b839-e151f9f93971', 'volume_name': 'volume-fa45f468-2230-4ba2-b839-e151f9f93971', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.252278 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d584393b-4c31-4c44-8e14-73468f8f9f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.256276 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d584393b-4c31-4c44-8e14-73468f8f9f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.261062 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af568c2c-249a-4281-814a-4fc9a2086b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.262486 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Volume fa45f468-2230-4ba2-b839-e151f9f93971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa45f468-2230-4ba2-b839-e151f9f93971', 'volume_size': 1}
Aug 27 21:18:56.263025 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] creating volume 'volume-fa45f468-2230-4ba2-b839-e151f9f93971' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:18:56.263992 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:18:56.374165 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:18:56.375240 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:18:56.379171 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af568c2c-249a-4281-814a-4fc9a2086b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa45f468-2230-4ba2-b839-e151f9f93971', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.386709 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda8466-d8bf-451d-8c16-56e0f762be3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:18:56.399869 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-fa45f468-2230-4ba2-b839-e151f9f93971 (fa45f468-2230-4ba2-b839-e151f9f93971): created successfully
Aug 27 21:18:56.404933 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbda8466-d8bf-451d-8c16-56e0f762be3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:18:56.412621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (fc31e917-6123-4906-b566-1a6244ffdc40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:18:56.423919 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-394103e9-a40f-4443-aec7-5a2b57376fb8 tempest-VolumesBackupsAdminTest-2065991599 None] Created volume successfully.
Aug 27 21:18:57.459185 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-27T21:18:57Z,data_timestamp=2022-08-27T21:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-1828376068',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=bd575950-a2ad-443a-a5e6-22a61ae578fb,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='46ec2f76215f4427a2158434b721dbfe',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a9ca761e029947a1ab18e357242a2838',volume_id=fa45f468-2230-4ba2-b839-e151f9f93971)
Aug 27 21:18:57.461646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.backup.rpcapi [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] continue_backup in rpcapi backup_id bd575950-a2ad-443a-a5e6-22a61ae578fb {{(pid=133391) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 27 21:18:57.591056 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:18:58.673495 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.082s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:18:58.674534 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fa45f468-2230-4ba2-b839-e151f9f93971', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'fa45f468-2230-4ba2-b839-e151f9f93971', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:18:58.702591 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] Initialize volume connection completed successfully.
Aug 27 21:19:00.708175 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] Terminate volume connection completed successfully.
Aug 27 21:19:00.732766 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ca04e07c-80c8-4c75-b95d-e7fe8d227394 tempest-VolumesBackupsAdminTest-2065991599 None] Remove volume export completed successfully.
Aug 27 21:19:02.872507 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:19:02.873781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:02.950050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:02.990424 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:03.730898 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:03.753429 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (6160a1c2-289e-46a2-b99c-c98d5b559a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:03.760214 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e64188c-e228-4fb1-8273-4814e58d4ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.779302 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e64188c-e228-4fb1-8273-4814e58d4ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:03Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_bd575950-a2ad-443a-a5e6-22a61ae578fb',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b04bc462-1df3-4dc4-9570-509b90757f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ec2f76215f4427a2158434b721dbfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:04Z,use_quota=True,user_id='a9ca761e029947a1ab18e357242a2838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.785661 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbbbd71-cf40-4556-9af0-8b6d66ebf714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.790125 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fbbbd71-cf40-4556-9af0-8b6d66ebf714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.796044 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f804f4a3-47c0-4751-9f98-990a3a573eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.800948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f804f4a3-47c0-4751-9f98-990a3a573eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b04bc462-1df3-4dc4-9570-509b90757f5b', 'volume_name': 'volume-b04bc462-1df3-4dc4-9570-509b90757f5b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.806068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd3382d-a69f-424c-89fd-4736ec349acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.810889 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bd3382d-a69f-424c-89fd-4736ec349acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.816136 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600f0e47-84e3-4859-8db6-f18cd294c15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.817350 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Volume b04bc462-1df3-4dc4-9570-509b90757f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b04bc462-1df3-4dc4-9570-509b90757f5b', 'volume_size': 1}
Aug 27 21:19:03.817860 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] creating volume 'volume-b04bc462-1df3-4dc4-9570-509b90757f5b' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:03.818725 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:03.891932 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:03.892623 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:03.897138 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (600f0e47-84e3-4859-8db6-f18cd294c15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b04bc462-1df3-4dc4-9570-509b90757f5b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.907399 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2109928-8201-4bec-9fc2-fc0450b13735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:03.926973 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-b04bc462-1df3-4dc4-9570-509b90757f5b (b04bc462-1df3-4dc4-9570-509b90757f5b): created successfully
Aug 27 21:19:03.935224 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2109928-8201-4bec-9fc2-fc0450b13735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:03.941777 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (6160a1c2-289e-46a2-b99c-c98d5b559a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:03.953888 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Created volume successfully.
Aug 27 21:19:04.845436 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:19:05.749055 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.903s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:19:05.751716 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b04bc462-1df3-4dc4-9570-509b90757f5b', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'b04bc462-1df3-4dc4-9570-509b90757f5b', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:19:05.810436 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Initialize volume connection completed successfully.
Aug 27 21:19:07.926112 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Terminate volume connection completed successfully.
Aug 27 21:19:07.996404 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f84d746a-15e3-4811-b47c-ec893645b857 tempest-VolumesBackupsAdminTest-2065991599 None] Remove volume export completed successfully.
Aug 27 21:19:09.250547 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Acquiring lock "cinder-b04bc462-1df3-4dc4-9570-509b90757f5b-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:09.276624 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-b04bc462-1df3-4dc4-9570-509b90757f5b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:09.428263 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:10.573931 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-b04bc462-1df3-4dc4-9570-509b90757f5b is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:10.593525 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] deleting rbd volume volume-b04bc462-1df3-4dc4-9570-509b90757f5b {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:10.921471 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Created reservations ['51c3a4f7-f788-4811-8d10-73a2300e6957', 'ea13af34-b486-440c-b086-dbf860fc21e8', 'eef9283a-5f8e-4db1-9ce3-1fa1dfed1286', '52656382-7f95-4ed8-b92f-ac849fe1d8eb'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:10.989298 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:11.070415 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:11.126989 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:11.135670 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Deleted volume successfully.
Aug 27 21:19:11.151902 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-064ea3ea-9a69-411e-b9ae-864b0cd3616d tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-b04bc462-1df3-4dc4-9570-509b90757f5b-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:13.184114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:13.217799 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (4f4e52a9-6bed-4830-9bdb-981d338ec2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:13.227477 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f56eef-d493-4760-b73c-d35391a95fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.250509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f56eef-d493-4760-b73c-d35391a95fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-38255405',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bf16017d-0277-45d6-9954-d577d208d608,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ec2f76215f4427a2158434b721dbfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:13Z,use_quota=True,user_id='a9ca761e029947a1ab18e357242a2838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.256763 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045148a2-b0f0-4fb5-949a-f57302f996a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.263070 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045148a2-b0f0-4fb5-949a-f57302f996a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.270612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa8a020-339f-43c5-8c95-7d7f947388d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.279509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa8a020-339f-43c5-8c95-7d7f947388d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf16017d-0277-45d6-9954-d577d208d608', 'volume_name': 'volume-bf16017d-0277-45d6-9954-d577d208d608', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.289138 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e2b07a-cafb-48b0-bcab-e8b92446839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.298591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e2b07a-cafb-48b0-bcab-e8b92446839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.306902 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f838b8-2588-46dd-b382-ef079a43f039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.307831 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Volume bf16017d-0277-45d6-9954-d577d208d608: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf16017d-0277-45d6-9954-d577d208d608', 'volume_size': 1}
Aug 27 21:19:13.308230 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] creating volume 'volume-bf16017d-0277-45d6-9954-d577d208d608' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:13.309140 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:13.404743 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:13.405515 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:13.415741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f838b8-2588-46dd-b382-ef079a43f039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf16017d-0277-45d6-9954-d577d208d608', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.428748 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b819f6-9436-4745-b1d3-5fe4e51d1750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:13.447840 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-bf16017d-0277-45d6-9954-d577d208d608 (bf16017d-0277-45d6-9954-d577d208d608): created successfully
Aug 27 21:19:13.456667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6b819f6-9436-4745-b1d3-5fe4e51d1750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:13.465608 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Flow 'volume_create_manager' (4f4e52a9-6bed-4830-9bdb-981d338ec2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:13.478415 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-55637130-9fde-42a3-97d5-4c8dfe9c5b36 tempest-VolumesBackupsAdminTest-2065991599 None] Created volume successfully.
Aug 27 21:19:14.469272 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-27T21:19:14Z,data_timestamp=2022-08-27T21:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-336575566',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=c2047566-7ed5-4d6e-9b2e-28c95b8b52e9,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='46ec2f76215f4427a2158434b721dbfe',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='a9ca761e029947a1ab18e357242a2838',volume_id=bf16017d-0277-45d6-9954-d577d208d608)
Aug 27 21:19:14.470205 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.backup.rpcapi [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] continue_backup in rpcapi backup_id c2047566-7ed5-4d6e-9b2e-28c95b8b52e9 {{(pid=133391) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 27 21:19:14.598955 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:19:15.476898 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.878s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:19:15.481650 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-bf16017d-0277-45d6-9954-d577d208d608', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'bf16017d-0277-45d6-9954-d577d208d608', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:19:15.519554 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] Initialize volume connection completed successfully.
Aug 27 21:19:17.420602 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] Terminate volume connection completed successfully.
Aug 27 21:19:17.445641 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05e202ce-56d7-492a-894a-4185ac54fcbd tempest-VolumesBackupsAdminTest-2065991599 None] Remove volume export completed successfully.
Aug 27 21:19:20.039307 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Acquiring lock "cinder-bf16017d-0277-45d6-9954-d577d208d608-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:20.052414 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-bf16017d-0277-45d6-9954-d577d208d608-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:20.101488 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:20.721462 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-bf16017d-0277-45d6-9954-d577d208d608 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:20.740788 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] deleting rbd volume volume-bf16017d-0277-45d6-9954-d577d208d608 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:20.984021 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Created reservations ['d4b61516-7daf-4aa1-96f5-f4ce4c9d79d3', 'c93a1b7c-588c-4b83-8e9c-3f22a082dba0', '0ce3296a-44cf-4c12-86fa-2c50924732c8', '5b51f609-6750-44e8-97aa-9838c4a86cc5'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:21.045898 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:21.088363 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:21.150069 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:21.162829 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Deleted volume successfully.
Aug 27 21:19:21.183061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-7aeb3f50-8c95-4693-9c3c-d39f72dcfe3d tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-bf16017d-0277-45d6-9954-d577d208d608-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:21.329762 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Acquiring lock "cinder-fa45f468-2230-4ba2-b839-e151f9f93971-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:21.360310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-fa45f468-2230-4ba2-b839-e151f9f93971-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:21.451281 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:21.753422 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Volume volume-fa45f468-2230-4ba2-b839-e151f9f93971 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:21.782824 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] deleting rbd volume volume-fa45f468-2230-4ba2-b839-e151f9f93971 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:22.077272 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=70,cinder:UPDATE=23,cinder:DELETE=4,cinder:INSERT=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:22.111349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Created reservations ['5a087c1a-1ae6-4124-ad81-7a7050809139', '86d8aed4-7c95-4501-87df-4b704c676cf9', '0063b27b-3d44-43da-bb1d-0023ecd7e0c0', 'e8bacf1b-2e64-4dcc-a205-346837d92032'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:22.146911 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:22.171035 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:22.220506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:22.279938 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:22.286465 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Deleted volume successfully.
Aug 27 21:19:22.317546 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-503344f2-4255-4c54-a829-19845bff09ef tempest-VolumesBackupsAdminTest-2065991599 None] Lock "cinder-fa45f468-2230-4ba2-b839-e151f9f93971-delete_volume" released by "delete_volume" :: held 0.957s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:27.942149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Acquiring lock "cinder-bd39b830-6dd7-44ea-bb11-15a2d1f5987b-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:27.957953 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Lock "cinder-bd39b830-6dd7-44ea-bb11-15a2d1f5987b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:28.020717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:28.117593 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:28.118570 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:28.124395 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] deleting rbd volume volume-bd39b830-6dd7-44ea-bb11-15a2d1f5987b {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:28.416393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Created reservations ['06b1e256-aef7-4bf0-bdca-a686869750b8', '51007fa8-ddf8-4e3b-9476-82f35ffb1e4a', 'eaa87039-cffc-482c-aeae-3055807563e1', '273422d7-7b37-4042-92ee-7b15e9753836'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:28.497556 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:28.571325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:28.666896 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:28.673535 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Deleted volume successfully.
Aug 27 21:19:28.696703 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-41c620c3-a884-48f4-8da1-c0daf94eb93f tempest-AttachVolumeShelveTestJSON-1808861972 None] Lock "cinder-bd39b830-6dd7-44ea-bb11-15a2d1f5987b-delete_volume" released by "delete_volume" :: held 0.739s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:29.310764 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Acquiring lock "cinder-0ebdf631-522c-4ca4-8edd-98bd7239f81e-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:29.357743 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Lock "cinder-0ebdf631-522c-4ca4-8edd-98bd7239f81e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:29.458610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:29.544541 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:29.545179 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Volume volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:29.558647 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] deleting rbd volume volume-0ebdf631-522c-4ca4-8edd-98bd7239f81e {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:29.858459 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Created reservations ['408b03bf-17c4-495c-8cdd-dd65494275a9', 'c63f288a-1575-4ed8-88ca-d0b5b1e920ae', '0f7997ac-4921-49ae-a44f-f37ca035e1ba', '7297a65a-c898-40de-b19b-dfa6c716028a'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:29.932106 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:30.007750 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:30.063873 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:30.068727 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Deleted volume successfully.
Aug 27 21:19:30.087577 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5aff27bb-f3a4-4d0b-9689-95f5a1a687df tempest-AttachVolumeShelveTestJSON-1808861972 None] Lock "cinder-0ebdf631-522c-4ca4-8edd-98bd7239f81e-delete_volume" released by "delete_volume" :: held 0.734s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:30.827152 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:30.870846 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Flow 'volume_create_manager' (f0e5abb8-4858-4074-9004-3e0ff365e1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:30.878919 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e22b25-f1d0-401f-9c49-050e3762611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:30.900153 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36e22b25-f1d0-401f-9c49-050e3762611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1761967175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=979fcdfc-9b2b-4668-a012-b0e0218785bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ca289b36ce4640ba7bbeecc55e3f03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:31Z,use_quota=True,user_id='02748b44d40a4725a550bd3d7e629dc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:30.906534 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f96b6-be01-4994-86f4-4105b1052dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:30.910688 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f96b6-be01-4994-86f4-4105b1052dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:30.918115 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bb350a-3a95-4e93-bd9e-786245bf100a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:30.922817 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92bb350a-3a95-4e93-bd9e-786245bf100a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '979fcdfc-9b2b-4668-a012-b0e0218785bb', 'volume_name': 'volume-979fcdfc-9b2b-4668-a012-b0e0218785bb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:30.928783 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3639a-9c3c-4181-b585-0ab9b685ea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:30.933168 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc3639a-9c3c-4181-b585-0ab9b685ea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:30.949719 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92819f-6ed6-4cb9-8e47-ac1157f1312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:30.951094 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Volume 979fcdfc-9b2b-4668-a012-b0e0218785bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-979fcdfc-9b2b-4668-a012-b0e0218785bb', 'volume_size': 1}
Aug 27 21:19:30.952029 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] creating volume 'volume-979fcdfc-9b2b-4668-a012-b0e0218785bb' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:30.953711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:31.032076 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:31.032454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:31.036546 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed92819f-6ed6-4cb9-8e47-ac1157f1312a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-979fcdfc-9b2b-4668-a012-b0e0218785bb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:31.042770 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31de983e-ebe3-479a-97ff-cebe90fcfd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:31.054764 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Volume volume-979fcdfc-9b2b-4668-a012-b0e0218785bb (979fcdfc-9b2b-4668-a012-b0e0218785bb): created successfully
Aug 27 21:19:31.059853 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31de983e-ebe3-479a-97ff-cebe90fcfd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:31.066215 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Flow 'volume_create_manager' (f0e5abb8-4858-4074-9004-3e0ff365e1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:31.076833 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-48fe3083-e84e-466d-b1cb-b44a154e9ed8 tempest-AbsoluteLimitsTests-1856664027 None] Created volume successfully.
Aug 27 21:19:32.067741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Acquiring lock "cinder-979fcdfc-9b2b-4668-a012-b0e0218785bb-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:32.093656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Lock "cinder-979fcdfc-9b2b-4668-a012-b0e0218785bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:32.149234 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:32.265222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:32.265788 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Volume volume-979fcdfc-9b2b-4668-a012-b0e0218785bb is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:32.271745 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] deleting rbd volume volume-979fcdfc-9b2b-4668-a012-b0e0218785bb {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:32.601093 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Created reservations ['4cdc112d-d851-44b8-9abd-c44efd87ede6', '2d81064e-fd05-4003-8beb-feb44d0c785b', '69f10ddb-2d4e-475d-8bd9-9ac42b92d9fa', 'd1f22ef6-d20c-40a9-90d5-99a4cac5c9e5'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:32.693934 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:32.749902 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:32.819940 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:32.825417 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Deleted volume successfully.
Aug 27 21:19:32.852352 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-cc8ab258-6ee3-476f-9145-fc28c5bb3f8d tempest-AbsoluteLimitsTests-1856664027 None] Lock "cinder-979fcdfc-9b2b-4668-a012-b0e0218785bb-delete_volume" released by "delete_volume" :: held 0.759s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:39.451828 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:39.478509 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Flow 'volume_create_manager' (b640c6b4-b2f5-4a3b-9a2d-b463095ff3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:39.486582 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161ab5f-f53b-4e96-82de-4bc796278b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.509403 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f161ab5f-f53b-4e96-82de-4bc796278b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-252885706',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6f09efe8-1a68-4d51-b97a-e5ceed5ba204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b164cc4b0a4109b1dc8f9dea832923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:39Z,use_quota=True,user_id='2b8a2c8b204f4c9a9110b5c6cabad2db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.516437 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb97444-c710-491a-bec5-acf822c19a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.521145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb97444-c710-491a-bec5-acf822c19a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.527445 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba98b952-4f67-44b7-a53c-175a5dce2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.532668 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba98b952-4f67-44b7-a53c-175a5dce2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f09efe8-1a68-4d51-b97a-e5ceed5ba204', 'volume_name': 'volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.538157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3246bc35-5f4a-4522-80a3-2594e4202d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.543155 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3246bc35-5f4a-4522-80a3-2594e4202d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.549157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b91d5-8633-475e-bf78-4896f2e23080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.550548 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Volume 6f09efe8-1a68-4d51-b97a-e5ceed5ba204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204', 'volume_size': 1}
Aug 27 21:19:39.551080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] creating volume 'volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:39.552212 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:39.645531 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:39.645882 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:39.650013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b91d5-8633-475e-bf78-4896f2e23080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.654560 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed32476-c687-48ff-9d36-f62d510d4d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:39.668405 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Volume volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204 (6f09efe8-1a68-4d51-b97a-e5ceed5ba204): created successfully
Aug 27 21:19:39.672321 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed32476-c687-48ff-9d36-f62d510d4d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:39.679800 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Flow 'volume_create_manager' (b640c6b4-b2f5-4a3b-9a2d-b463095ff3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:39.691260 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f1448d10-5b5b-4e39-9a2d-5014ada409d2 tempest-VolumesMetadataTest-1333269923 None] Created volume successfully.
Aug 27 21:19:41.250802 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Acquiring lock "cinder-6f09efe8-1a68-4d51-b97a-e5ceed5ba204-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:41.268857 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Lock "cinder-6f09efe8-1a68-4d51-b97a-e5ceed5ba204-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:41.277274 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=36,cinder:SELECT=53,cinder:DELETE=1,cinder:INSERT=10 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:41.388053 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:41.477890 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:41.478309 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Volume volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:41.489715 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] deleting rbd volume volume-6f09efe8-1a68-4d51-b97a-e5ceed5ba204 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:41.984268 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Created reservations ['eb958cf9-821d-4c6b-bcf6-fae47bdfc6b1', '3c72aac4-062a-4421-b1d6-e2a53dd7a8ea', '7cfefa80-d4cd-4b13-95cc-e96f982f021a', '4e9c7a96-26d4-4560-948c-3e60fefb0c52'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:42.011727 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d99ffeae-cc33-4ce7-9073-04820195b6f9 tempest-BackendsCapabilitiesAdminTestsJSON-557255796 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f60509cb-0788-4b7d-926f-6a9af5c8f250:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Aug 27 21:19:42.065348 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-73247ca5-177d-4a5e-ba99-2a8fd8281e1a tempest-BackendsCapabilitiesAdminTestsJSON-557255796 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f60509cb-0788-4b7d-926f-6a9af5c8f250:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=133391) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Aug 27 21:19:42.093991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:42.171254 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:42.242676 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:42.258360 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=5,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:42.262439 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Deleted volume successfully.
Aug 27 21:19:42.296013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0a037a9c-35cb-4c98-bd67-e73b66ad0201 tempest-VolumesMetadataTest-1333269923 None] Lock "cinder-6f09efe8-1a68-4d51-b97a-e5ceed5ba204-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:42.300931 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:42.326405 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Flow 'volume_create_manager' (3171b3e5-18c2-4487-b3f0-33bc86b7b34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:42.334824 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce912f15-0db2-4001-95f4-efa6f4142cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.362016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce912f15-0db2-4001-95f4-efa6f4142cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2042054670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=570320b7-b528-486a-8248-c9d3f5211c7f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='204c7f096bc64648a5574ebc8300eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:42Z,use_quota=True,user_id='d52ee9a957404692a393e9f491dacf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.377145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da74ea1-22c9-41ac-a505-aeab0bbab9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.394150 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da74ea1-22c9-41ac-a505-aeab0bbab9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.399508 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85f3e49-7a51-4efe-98bf-99a76939c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.408705 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b85f3e49-7a51-4efe-98bf-99a76939c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570320b7-b528-486a-8248-c9d3f5211c7f', 'volume_name': 'volume-570320b7-b528-486a-8248-c9d3f5211c7f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.415757 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c18e5e7-02b2-4270-8a3e-a547f31e26bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.419885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c18e5e7-02b2-4270-8a3e-a547f31e26bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.425325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53353068-74da-46f1-a67a-9854e2c76e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.426669 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Volume 570320b7-b528-486a-8248-c9d3f5211c7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570320b7-b528-486a-8248-c9d3f5211c7f', 'volume_size': 1}
Aug 27 21:19:42.427368 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] creating volume 'volume-570320b7-b528-486a-8248-c9d3f5211c7f' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:42.428157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:42.549068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:42.550089 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:42.555955 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53353068-74da-46f1-a67a-9854e2c76e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570320b7-b528-486a-8248-c9d3f5211c7f', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.566781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1cd2dc-2cae-48be-9a90-2350335f8f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:42.585432 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Volume volume-570320b7-b528-486a-8248-c9d3f5211c7f (570320b7-b528-486a-8248-c9d3f5211c7f): created successfully
Aug 27 21:19:42.591615 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac1cd2dc-2cae-48be-9a90-2350335f8f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:42.603587 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Flow 'volume_create_manager' (3171b3e5-18c2-4487-b3f0-33bc86b7b34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:42.630842 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-cc7d39c7-79a0-48b0-9ed1-a34ccd60db0a req-359104eb-6afb-463e-84dc-632e23b0cfc0 tempest-VolumesGetTestJSON-678210298 None] Created volume successfully.
Aug 27 21:19:43.626591 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Acquiring lock "cinder-570320b7-b528-486a-8248-c9d3f5211c7f-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:19:43.644539 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Lock "cinder-570320b7-b528-486a-8248-c9d3f5211c7f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:19:43.748823 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:43.844978 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:43.846136 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Volume volume-570320b7-b528-486a-8248-c9d3f5211c7f is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:43.855744 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] deleting rbd volume volume-570320b7-b528-486a-8248-c9d3f5211c7f {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:44.283867 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Created reservations ['cb5c5527-53d1-4ec1-89c3-d1db186d4c0b', '736cf3ad-4531-4fde-8197-31cf9eeb6bee', '3af96d10-78f0-45b0-bd8f-d1fa0a4d94e0', '289404a5-fbe9-40c7-a809-9e2f025354e1'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:44.414240 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:44.470374 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:44.536981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:44.557022 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Deleted volume successfully.
Aug 27 21:19:44.575592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [req-cd0f9806-bafe-4de0-b8d5-503f3769e2d6 req-3379df42-fda7-4aff-b0c7-692d7670f0e2 tempest-VolumesGetTestJSON-678210298 None] Lock "cinder-570320b7-b528-486a-8248-c9d3f5211c7f-delete_volume" released by "delete_volume" :: held 0.930s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:19:48.664794 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:48.685694 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (a6e405eb-3a21-443e-89bc-7c9697a60dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:48.692162 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42ba309-401d-4235-abb0-6494ea212a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.708691 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42ba309-401d-4235-abb0-6494ea212a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1319157301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=78f14686-a6e3-4290-b213-3298d690e345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:49Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.714347 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d443f3e-13ce-46b8-8d2c-3d16deb25dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.718520 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d443f3e-13ce-46b8-8d2c-3d16deb25dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.723563 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0eae91-54c7-4f27-88a5-875004228a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.727535 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0eae91-54c7-4f27-88a5-875004228a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78f14686-a6e3-4290-b213-3298d690e345', 'volume_name': 'volume-78f14686-a6e3-4290-b213-3298d690e345', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.732290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616cfaff-d47f-4555-ab7e-1273a0a232cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.736273 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (616cfaff-d47f-4555-ab7e-1273a0a232cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.740923 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe52d8d-6bd0-46d8-9c85-2901d7416586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.742035 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Volume 78f14686-a6e3-4290-b213-3298d690e345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78f14686-a6e3-4290-b213-3298d690e345', 'volume_size': 1}
Aug 27 21:19:48.742589 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] creating volume 'volume-78f14686-a6e3-4290-b213-3298d690e345' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:48.743393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:48.808919 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:48.809339 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:48.814816 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe52d8d-6bd0-46d8-9c85-2901d7416586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78f14686-a6e3-4290-b213-3298d690e345', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.819738 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d4911-600d-4153-9112-65ffebff6e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:48.830198 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-78f14686-a6e3-4290-b213-3298d690e345 (78f14686-a6e3-4290-b213-3298d690e345): created successfully
Aug 27 21:19:48.834459 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79d4911-600d-4153-9112-65ffebff6e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:48.840393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (a6e405eb-3a21-443e-89bc-7c9697a60dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:48.850542 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4840756f-d33f-412f-9e42-3f9ffcb0e781 tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:19:49.941547 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0c3a4f89-796f-4f40-9367-9e101a65f4f9 tempest-GroupsTest-1785052484 None] Group tempest-Group1-1490691141: creating
Aug 27 21:19:49.997327 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0c3a4f89-796f-4f40-9367-9e101a65f4f9 tempest-GroupsTest-1785052484 None] Group tempest-Group1-1490691141: created successfully
Aug 27 21:19:50.045140 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0c3a4f89-796f-4f40-9367-9e101a65f4f9 tempest-GroupsTest-1785052484 None] Create group completed successfully.
Aug 27 21:19:50.070940 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87f82247-f55f-464c-bfe7-189a81da2732 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:50.664927 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-87f82247-f55f-464c-bfe7-189a81da2732 tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:19:51.254071 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-592cbd7a-d57c-4dd0-a62c-e924b00dbfcf tempest-GroupsTest-1785052484 None] Group tempest-Group2-1096675835: creating
Aug 27 21:19:51.328369 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-592cbd7a-d57c-4dd0-a62c-e924b00dbfcf tempest-GroupsTest-1785052484 None] Group tempest-Group2-1096675835: created successfully
Aug 27 21:19:51.366565 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-592cbd7a-d57c-4dd0-a62c-e924b00dbfcf tempest-GroupsTest-1785052484 None] Create group completed successfully.
Aug 27 21:19:51.506665 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.driver [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Creating a new backup for volume volume-78f14686-a6e3-4290-b213-3298d690e345. {{(pid=133391) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1218}}
Aug 27 21:19:51.548911 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] cloning volumes/volume-78f14686-a6e3-4290-b213-3298d690e345@snapshot-e3a90117-7e47-48c9-aaf3-701d7fdad296 to volume-0f7536ac-e9ff-41fc-a4d0-f66b4910937d {{(pid=133391) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Aug 27 21:19:51.549855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:51.620933 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:51.740381 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:51.741262 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:51.769575 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-27T21:19:51Z,data_timestamp=2022-08-27T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Backup-290486057',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=736d5527-8e3e-467d-8b49-ecea2f012048,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id='e3a90117-7e47-48c9-aaf3-701d7fdad296',status='creating',temp_snapshot_id=None,temp_volume_id='0f7536ac-e9ff-41fc-a4d0-f66b4910937d',updated_at=None,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_id=78f14686-a6e3-4290-b213-3298d690e345)
Aug 27 21:19:51.770363 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.backup.rpcapi [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] continue_backup in rpcapi backup_id 736d5527-8e3e-467d-8b49-ecea2f012048 {{(pid=133391) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 27 21:19:51.924195 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:19:53.034503 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:19:53.057141 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (36db4108-a257-4b9b-94f6-fccdb6efddf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:53.072873 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f057132e-f984-4964-af2c-2c77fa49ec83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.124349 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f057132e-f984-4964-af2c-2c77fa49ec83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1927565388',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=21ca1e3a-adbf-4cb2-bd14-fb7b584603bb,host='ncdv-master-1@ceph#ceph',id=d99b5484-4535-483a-8404-5525659cd719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edc566cbb524935a9746cd7394125f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:19:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:19:53Z,use_quota=True,user_id='3b92ad741540453fb69c3d0a02309603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3474727c-1920-4707-ad6e-4c5e5031fd32),volume_type_id=3474727c-1920-4707-ad6e-4c5e5031fd32)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.133132 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b968ba-f02d-4efb-acea-c94404dfdf59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.137843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b968ba-f02d-4efb-acea-c94404dfdf59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.146024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a87f75-8fe7-4370-a651-d34696a214c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.151701 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a87f75-8fe7-4370-a651-d34696a214c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd99b5484-4535-483a-8404-5525659cd719', 'volume_name': 'volume-d99b5484-4535-483a-8404-5525659cd719', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.158232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8303f8-1010-4ac4-84bc-0337c817ba8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.163840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8303f8-1010-4ac4-84bc-0337c817ba8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.169891 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da86785-c392-4f11-ab35-1371cbfd5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.171713 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Volume d99b5484-4535-483a-8404-5525659cd719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d99b5484-4535-483a-8404-5525659cd719', 'volume_size': 1}
Aug 27 21:19:53.172295 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] creating volume 'volume-d99b5484-4535-483a-8404-5525659cd719' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:19:53.174366 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:53.236588 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.312s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:19:53.238198 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0f7536ac-e9ff-41fc-a4d0-f66b4910937d', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '0f7536ac-e9ff-41fc-a4d0-f66b4910937d', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:19:53.256027 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Initialize volume connection completed successfully.
Aug 27 21:19:53.282862 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:19:53.284477 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:19:53.291125 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da86785-c392-4f11-ab35-1371cbfd5c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d99b5484-4535-483a-8404-5525659cd719', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.299634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c0c7c4-2797-412f-ad74-904261298fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:19:53.321569 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Volume volume-d99b5484-4535-483a-8404-5525659cd719 (d99b5484-4535-483a-8404-5525659cd719): created successfully
Aug 27 21:19:53.325387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c0c7c4-2797-412f-ad74-904261298fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:19:53.332262 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (36db4108-a257-4b9b-94f6-fccdb6efddf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:19:53.362049 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9e107ed2-023a-4911-b482-37880d053dc5 tempest-GroupsTest-1785052484 None] Created volume successfully.
Aug 27 21:19:55.152550 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:55.235784 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:19:55.236239 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Volume volume-d99b5484-4535-483a-8404-5525659cd719 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:19:55.268910 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] deleting rbd volume volume-d99b5484-4535-483a-8404-5525659cd719 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:19:55.743320 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Created reservations ['701849e8-5a4e-4a4d-9278-21fc0a3e583b'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:55.826816 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=66,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:55.832481 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-746084840 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-746084840, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:19:55.835480 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-746084840 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-746084840, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:19:55.874887 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Created reservations ['c565340a-241b-4fc6-9fae-515e174717d5', '7fd23d41-3de6-4d46-a13e-704d38b36c59', '995c17dd-08ae-4045-8fdf-a812e05d5584', 'f9423ee5-33c7-4c4c-8cbc-18498e0d80c0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:55.912227 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:INSERT=8,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:19:56.161576 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:56.272006 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:56.369565 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:56.390618 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1f1268c9-5b7d-4071-bedd-dbc045c807c2 tempest-GroupsTest-1785052484 None] Delete group completed successfully.
Aug 27 21:19:56.570632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ad91d1a6-b813-4bf6-8466-97fbc227de79 tempest-GroupsTest-1785052484 None] Created reservations ['1b82eeec-4da1-4316-9d25-362b6b36a244'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:19:56.670381 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ad91d1a6-b813-4bf6-8466-97fbc227de79 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:56.779736 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ad91d1a6-b813-4bf6-8466-97fbc227de79 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:19:56.865685 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-ad91d1a6-b813-4bf6-8466-97fbc227de79 tempest-GroupsTest-1785052484 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:19:56.871226 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ad91d1a6-b813-4bf6-8466-97fbc227de79 tempest-GroupsTest-1785052484 None] Delete group completed successfully.
Aug 27 21:19:58.477454 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6d256d9e-0216-481e-aa9e-ddae25fcfc2f tempest-GroupsTest-1785052484 None] Group tempest-GroupsTest-Group-2014695082: creating
Aug 27 21:19:58.528411 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6d256d9e-0216-481e-aa9e-ddae25fcfc2f tempest-GroupsTest-1785052484 None] Group tempest-GroupsTest-Group-2014695082: created successfully
Aug 27 21:19:58.548116 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6d256d9e-0216-481e-aa9e-ddae25fcfc2f tempest-GroupsTest-1785052484 None] Create group completed successfully.
Aug 27 21:20:00.282752 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:00.336983 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (baa1dbf4-2c0b-4442-a6be-66fddc1fabd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:00.355217 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ef6963-d3b4-4526-8100-41b3be99c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.396541 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ef6963-d3b4-4526-8100-41b3be99c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-542368618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e1f530f-442d-48fb-a2c0-9f511c03ac0c,host='ncdv-master-1@ceph#ceph',id=530ae311-fd50-4570-942e-2fb39caa7f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edc566cbb524935a9746cd7394125f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:00Z,use_quota=True,user_id='3b92ad741540453fb69c3d0a02309603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(601aa55b-dca7-4ef9-8722-00af24588b61),volume_type_id=601aa55b-dca7-4ef9-8722-00af24588b61)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.406609 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd05c771-daa8-4c1c-8dd9-50194ce1c749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.441309 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd05c771-daa8-4c1c-8dd9-50194ce1c749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.442088 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb113af-5302-4cd0-b01c-91e87a06284d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.452005 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb113af-5302-4cd0-b01c-91e87a06284d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '530ae311-fd50-4570-942e-2fb39caa7f33', 'volume_name': 'volume-530ae311-fd50-4570-942e-2fb39caa7f33', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.477893 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6f5a51-9c51-4d7a-93f4-6b18d04db7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.482169 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6f5a51-9c51-4d7a-93f4-6b18d04db7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.487464 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9a9c3f-3449-4514-87bc-cffe34bf1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.488874 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Volume 530ae311-fd50-4570-942e-2fb39caa7f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-530ae311-fd50-4570-942e-2fb39caa7f33', 'volume_size': 1}
Aug 27 21:20:00.491855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] creating volume 'volume-530ae311-fd50-4570-942e-2fb39caa7f33' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:20:00.492839 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:00.749533 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:00.750185 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:00.762021 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d9a9c3f-3449-4514-87bc-cffe34bf1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530ae311-fd50-4570-942e-2fb39caa7f33', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.772006 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4b1482-06c6-4366-b3b4-bf729ba97a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:00.796195 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Volume volume-530ae311-fd50-4570-942e-2fb39caa7f33 (530ae311-fd50-4570-942e-2fb39caa7f33): created successfully
Aug 27 21:20:00.801617 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4b1482-06c6-4366-b3b4-bf729ba97a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:00.809668 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (baa1dbf4-2c0b-4442-a6be-66fddc1fabd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:00.841081 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-38066fd9-d09d-4e82-94ae-b01151180e46 tempest-GroupsTest-1785052484 None] Created volume successfully.
Aug 27 21:20:02.263493 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:02.293685 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (5675af54-e280-40de-a594-0d3b0a608cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:02.302760 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a97ccd-a9d1-4625-ac85-940e3f33f699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.326597 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a97ccd-a9d1-4625-ac85-940e3f33f699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-751719152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5e1f530f-442d-48fb-a2c0-9f511c03ac0c,host='ncdv-master-1@ceph#ceph',id=9bf67d5d-f130-4ae1-8ef5-f90b584106fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9edc566cbb524935a9746cd7394125f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:02Z,use_quota=True,user_id='3b92ad741540453fb69c3d0a02309603',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(601aa55b-dca7-4ef9-8722-00af24588b61),volume_type_id=601aa55b-dca7-4ef9-8722-00af24588b61)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.337558 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4484bf4-952b-4bd7-8d62-75fc04882385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.343628 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4484bf4-952b-4bd7-8d62-75fc04882385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.349958 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a515c60-fb73-4531-86fd-61382c32b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.355959 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a515c60-fb73-4531-86fd-61382c32b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf67d5d-f130-4ae1-8ef5-f90b584106fc', 'volume_name': 'volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.363911 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7197aea-97d6-4ac1-8738-ff9fe6a8792b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.368802 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7197aea-97d6-4ac1-8738-ff9fe6a8792b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.380024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6978859d-4d04-44f1-b495-8cdff4440161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.381821 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Volume 9bf67d5d-f130-4ae1-8ef5-f90b584106fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc', 'volume_size': 1}
Aug 27 21:20:02.382435 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] creating volume 'volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:20:02.383590 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:02.745655 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:02.750624 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:02.756500 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6978859d-4d04-44f1-b495-8cdff4440161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.770625 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9680708e-c903-4ba5-b820-062d90936c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:02.787240 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Volume volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc (9bf67d5d-f130-4ae1-8ef5-f90b584106fc): created successfully
Aug 27 21:20:02.792695 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9680708e-c903-4ba5-b820-062d90936c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:02.803175 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Flow 'volume_create_manager' (5675af54-e280-40de-a594-0d3b0a608cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:02.826220 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b16fadad-0d60-4b01-a562-0e02d4bcbdb7 tempest-GroupsTest-1785052484 None] Created volume successfully.
Aug 27 21:20:02.877717 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:20:02.879454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:02.990578 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:03.072616 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:03.670024 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-39580913-930e-4690-9580-c0d01076d46c tempest-GroupsTest-1785052484 None] Update group completed successfully.
Aug 27 21:20:05.342262 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e79d682a-aaac-4560-805e-5db4bb6b09bf tempest-GroupsTest-1785052484 None] Update group completed successfully.
Aug 27 21:20:07.163197 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:07.251377 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:07.251975 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Volume volume-530ae311-fd50-4570-942e-2fb39caa7f33 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:07.280980 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] deleting rbd volume volume-530ae311-fd50-4570-942e-2fb39caa7f33 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:07.807986 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:07.903273 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:07.904169 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Volume volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:07.916884 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] deleting rbd volume volume-9bf67d5d-f130-4ae1-8ef5-f90b584106fc {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:08.878354 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Created reservations ['d13f0b71-2c01-4807-bdb6-ba9c956d6b12'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:08.902702 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1053033001 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1053033001, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:20:08.903989 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1053033001 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1053033001, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:20:08.931952 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Created reservations ['b1e10fe0-5ac7-4e1f-ac1e-7b11a236e902', 'a9511f2a-6038-43cd-b577-0ee6ef9339b7', '47cda028-f312-4c89-8a49-4f2daef1a866', '5f05e54e-3d94-45a8-9da3-b074c7589f6f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:09.101865 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=29,cinder:SELECT=67,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:09.128014 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Created reservations ['e568da64-693e-4c42-9d9c-d173fcddb14a', 'f243f1d5-8620-478a-bacb-40f190df036c', 'b78b9756-0165-47d6-b188-e6e8cc652c7b', '7740c37f-bace-4e37-b1ba-dd339119e14e'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:09.318863 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:09.387066 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:09.444015 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:09.481755 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0a907797-5c9d-40e1-be47-695b989f0c96 tempest-GroupsTest-1785052484 None] Delete group completed successfully.
Aug 27 21:20:09.500542 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Terminate volume connection completed successfully.
Aug 27 21:20:09.528165 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Remove volume export completed successfully.
Aug 27 21:20:09.591064 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-0f7536ac-e9ff-41fc-a4d0-f66b4910937d-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:09.606783 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-0f7536ac-e9ff-41fc-a4d0-f66b4910937d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:09.642632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:09.736237 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:09.750859 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] deleting rbd volume volume-0f7536ac-e9ff-41fc-a4d0-f66b4910937d {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:10.038348 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=30,cinder:SELECT=62,cinder:INSERT=6,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:10.073429 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Deleted volume successfully.
Aug 27 21:20:10.089251 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-93b44079-7cd2-4dd2-b849-53935b340fcb tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-0f7536ac-e9ff-41fc-a4d0-f66b4910937d-delete_volume" released by "delete_volume" :: held 0.482s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:17.150051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:17.192812 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Flow 'volume_create_manager' (9cfed197-dc1c-491e-b98f-e0bc0082b974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:17.209174 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be81e372-ee78-4a7b-bba0-5192fa88596d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.228634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be81e372-ee78-4a7b-bba0-5192fa88596d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-938419824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f6a8c475-da78-47bf-a529-11a9c4d31b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f091bcad5b19442f8d58b779754f284f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:17Z,use_quota=True,user_id='4512e6e756754c2f8049bc9512fdc98c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.234564 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094c786-5cee-4a69-83d9-67c214798f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.239260 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2094c786-5cee-4a69-83d9-67c214798f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.246058 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb2b0a9-9db8-4372-b3e5-0511f3652e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.252313 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb2b0a9-9db8-4372-b3e5-0511f3652e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a8c475-da78-47bf-a529-11a9c4d31b30', 'volume_name': 'volume-f6a8c475-da78-47bf-a529-11a9c4d31b30', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.257385 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43bead-29e5-42c6-93cb-054d3ec84541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.261446 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43bead-29e5-42c6-93cb-054d3ec84541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.266906 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2837cff-a798-4092-8338-27a30f8d8ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.268320 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Volume f6a8c475-da78-47bf-a529-11a9c4d31b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a8c475-da78-47bf-a529-11a9c4d31b30', 'volume_size': 1}
Aug 27 21:20:17.269486 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] creating volume 'volume-f6a8c475-da78-47bf-a529-11a9c4d31b30' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:20:17.270498 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:17.414290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:17.414925 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:17.419325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2837cff-a798-4092-8338-27a30f8d8ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a8c475-da78-47bf-a529-11a9c4d31b30', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.428874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3d3753-b9cd-4480-bec8-1da2b5f79e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:17.459988 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Volume volume-f6a8c475-da78-47bf-a529-11a9c4d31b30 (f6a8c475-da78-47bf-a529-11a9c4d31b30): created successfully
Aug 27 21:20:17.463981 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3d3753-b9cd-4480-bec8-1da2b5f79e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:17.475538 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Flow 'volume_create_manager' (9cfed197-dc1c-491e-b98f-e0bc0082b974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:17.494141 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-591342b4-9a18-417a-b5be-0884353394cb tempest-SnapshotsActionsTest-394565177 None] Created volume successfully.
Aug 27 21:20:18.530987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2fb2ff99-a0d4-4301-ba1c-cdaa3c2205e7 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:18.862422 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2fb2ff99-a0d4-4301-ba1c-cdaa3c2205e7 tempest-SnapshotsActionsTest-394565177 None] Create snapshot completed successfully
Aug 27 21:20:20.677441 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-484095a2-09ac-4cc5-bcec-07c18dda23fb tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:21.928799 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-484095a2-09ac-4cc5-bcec-07c18dda23fb tempest-SnapshotsActionsTest-394565177 None] Create snapshot completed successfully
Aug 27 21:20:22.899622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] Acquiring lock "cinder-14dac253-d4c8-4ec6-9e18-8a6edf06f828-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:22.910879 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-14dac253-d4c8-4ec6-9e18-8a6edf06f828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:22.912398 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:24.002191 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] Created reservations ['6719ef30-45ba-4926-aa56-010dce40ffa3', 'eb5c747a-b8f2-44d5-b9ae-7698b7fcd17c', '1d0ea239-5fb5-4484-a85f-5df6ca9d1ef5', '800930f7-328c-405c-b6c1-8473d450f9d9'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:24.063049 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] Delete snapshot completed successfully.
Aug 27 21:20:24.069451 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-89a72ccd-6b4b-49ba-916a-af2063b1839c tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-14dac253-d4c8-4ec6-9e18-8a6edf06f828-delete_snapshot" released by "delete_snapshot" :: held 1.159s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:25.557601 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ed66ffd-cf49-4c43-83fa-8c5d58c3f33c tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:25.998061 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4ed66ffd-cf49-4c43-83fa-8c5d58c3f33c tempest-SnapshotsActionsTest-394565177 None] Create snapshot completed successfully
Aug 27 21:20:26.828963 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] Acquiring lock "cinder-2e651fc7-64c1-432b-9abc-a55149313461-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:26.854804 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-2e651fc7-64c1-432b-9abc-a55149313461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:26.864353 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:28.112544 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] Created reservations ['15885eee-b1e1-4261-ac16-b7b05f1451f5', '8039b5d2-e10c-4544-b907-cbc5f27ced5d', '8920501d-2746-43fe-9796-3fa9edbe5879', 'ec2aa3b9-66ab-4a2e-98e1-8dcaa12670c0'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:28.189995 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] Delete snapshot completed successfully.
Aug 27 21:20:28.196337 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f36cb5c8-dc2d-4135-bff6-dd9cbcd2a508 tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-2e651fc7-64c1-432b-9abc-a55149313461-delete_snapshot" released by "delete_snapshot" :: held 1.342s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:29.413381 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ee40864-d756-47c9-8bf0-5fb5e6d480d5 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:30.254674 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4ee40864-d756-47c9-8bf0-5fb5e6d480d5 tempest-SnapshotsActionsTest-394565177 None] Create snapshot completed successfully
Aug 27 21:20:30.700702 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] Acquiring lock "cinder-79722b69-f602-4991-9cf8-d0bbc755cf89-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:30.717251 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-79722b69-f602-4991-9cf8-d0bbc755cf89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:30.720850 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:31.258626 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=32,cinder:SELECT=57,cinder:DELETE=4,cinder:INSERT=7 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:31.288435 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] Created reservations ['8cab86c7-e6c9-40bf-a5f7-1f70491a4c0a', '610dafb6-f762-4bc9-a2f7-ce2911ed0be3', '179a05a1-9427-4d07-8d5d-2226c1f08827', '768a0854-5b59-448d-a745-2bb77a1b8ee9'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:31.360311 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] Delete snapshot completed successfully.
Aug 27 21:20:31.365346 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4ef81fe3-5850-432f-8f8a-5ed9b2ad407d tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-79722b69-f602-4991-9cf8-d0bbc755cf89-delete_snapshot" released by "delete_snapshot" :: held 0.648s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:32.414524 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-76a1b361-74e5-4a9c-938d-fc8bca509987 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:33.547947 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-76a1b361-74e5-4a9c-938d-fc8bca509987 tempest-SnapshotsActionsTest-394565177 None] Create snapshot completed successfully
Aug 27 21:20:33.604600 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=66,cinder:UPDATE=28,cinder:DELETE=1,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:33.623320 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:33.648730 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (7578a0cd-7541-43bc-b96e-75f0116d8d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:33.668565 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f864aa-b880-4b07-a91c-16c66912b462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:33.718918 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f864aa-b880-4b07-a91c-16c66912b462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-80628240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d3805c1d-d467-4a3e-9b08-bf8f6b1f350a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:34Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:33.734007 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93048b6c-fb13-416d-b888-338b38b37dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:33.740933 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93048b6c-fb13-416d-b888-338b38b37dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:33.749315 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482bc6cd-cec1-436e-8e94-abcca89b08cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:33.914604 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (482bc6cd-cec1-436e-8e94-abcca89b08cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'volume_name': 'volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4b0a60>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:33.923923 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8feb5ecc-d1eb-4d0f-afd6-eee142159d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:33.929896 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8feb5ecc-d1eb-4d0f-afd6-eee142159d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:33.936221 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3666c9ef-cd4a-4973-8990-35d4be762860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:33.937812 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Volume d3805c1d-d467-4a3e-9b08-bf8f6b1f350a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4b0a60>}
Aug 27 21:20:33.938694 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Cloning d3805c1d-d467-4a3e-9b08-bf8f6b1f350a from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:20:33.939844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:33.951948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:33.973454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 20, 33, 960229)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:20:33.974154 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:20:33.974741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:20:33.981176 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:33.982133 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:20:33.991711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 20, 33, 987480)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:20:33.992139 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:20:33.992578 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:20:34.015953 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:34.133123 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] creating snapshot='volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:20:34.506731 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a.clone_snap' to 'volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:20:34.718213 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:34.719564 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:34.719944 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:34.746113 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:20:34.747054 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Marking volume d3805c1d-d467-4a3e-9b08-bf8f6b1f350a as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:20:34.755156 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] Acquiring lock "cinder-4d49ac89-fc08-4048-b3e8-42731028e890-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:34.762495 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to d3805c1d-d467-4a3e-9b08-bf8f6b1f350a. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:20:34.763712 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Creating volume glance metadata for volume d3805c1d-d467-4a3e-9b08-bf8f6b1f350a backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:20:34.779027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-4d49ac89-fc08-4048-b3e8-42731028e890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:34.780737 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:35.000912 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3666c9ef-cd4a-4973-8990-35d4be762860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4b0a60>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:35.011233 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f0eb59-7fa8-43df-83b9-03dcbaec9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:35.029540 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a (d3805c1d-d467-4a3e-9b08-bf8f6b1f350a): created successfully
Aug 27 21:20:35.037496 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f0eb59-7fa8-43df-83b9-03dcbaec9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:35.061301 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (7578a0cd-7541-43bc-b96e-75f0116d8d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:35.079917 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e3b4ea85-cbaf-4040-a0f9-913d9278e62c tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:20:35.660058 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] Created reservations ['7be0c2bc-38c6-413d-a998-5037c6972294', '2ea57e58-f87a-498f-acd2-77fd431b3911', '6f62bb55-39a0-48ed-9afb-373044c14c5c', '15882cdd-9bf9-4dd4-a7e0-66d3b4e34be6'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:35.775479 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] Delete snapshot completed successfully.
Aug 27 21:20:35.797308 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0e5424c8-56a2-4e18-ae9c-4393e12cddc3 tempest-SnapshotsActionsTest-845852468 None] Lock "cinder-4d49ac89-fc08-4048-b3e8-42731028e890-delete_snapshot" released by "delete_snapshot" :: held 1.018s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:36.637491 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-d86a3e21-1152-475e-b7e9-e1da4e898572 req-8c9602b9-d23e-4183-b558-4fab74a3b955 tempest-VolumesSnapshotTestJSON-104348141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:20:36.711723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] Acquiring lock "cinder-faecc223-718f-48a5-af9d-8287cb5b0198-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:36.731003 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] Lock "cinder-faecc223-718f-48a5-af9d-8287cb5b0198-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:36.736697 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:37.791173 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] Created reservations ['8e177a25-bb11-44c3-8f81-b1650d14d144', '71e0eb7b-a73c-4640-be4f-c3ea422836ac', '7669fc89-4867-466a-a4a0-8aa6a896f422', 'eeeb34d7-706d-480a-905f-966e2b2550e8'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:37.795762 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-d86a3e21-1152-475e-b7e9-e1da4e898572 req-8c9602b9-d23e-4183-b558-4fab74a3b955 tempest-VolumesSnapshotTestJSON-104348141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.158s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:20:37.800613 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-d86a3e21-1152-475e-b7e9-e1da4e898572 req-8c9602b9-d23e-4183-b558-4fab74a3b955 tempest-VolumesSnapshotTestJSON-104348141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'd3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:20:37.852838 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-d86a3e21-1152-475e-b7e9-e1da4e898572 req-8c9602b9-d23e-4183-b558-4fab74a3b955 tempest-VolumesSnapshotTestJSON-104348141 None] Connection info returned from driver {'name': 'volumes/volume-d3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd3805c1d-d467-4a3e-9b08-bf8f6b1f350a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4d41825b-8987-4a65-8c0b-0847e290042b'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:20:37.911809 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] Delete snapshot completed successfully.
Aug 27 21:20:37.927469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d7ce15ba-957a-40fc-8b9f-3c13a187e1a5 tempest-SnapshotsActionsTest-394565177 None] Lock "cinder-faecc223-718f-48a5-af9d-8287cb5b0198-delete_snapshot" released by "delete_snapshot" :: held 1.196s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:37.943785 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-d86a3e21-1152-475e-b7e9-e1da4e898572 req-8c9602b9-d23e-4183-b558-4fab74a3b955 tempest-VolumesSnapshotTestJSON-104348141 None] attachment_update completed successfully.
Aug 27 21:20:38.924887 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Acquiring lock "cinder-f6a8c475-da78-47bf-a529-11a9c4d31b30-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:38.937472 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Lock "cinder-f6a8c475-da78-47bf-a529-11a9c4d31b30-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:39.012382 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:39.092415 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:39.093178 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Volume volume-f6a8c475-da78-47bf-a529-11a9c4d31b30 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:39.105892 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] deleting rbd volume volume-f6a8c475-da78-47bf-a529-11a9c4d31b30 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:39.424751 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Created reservations ['4f86ab67-d99c-46ed-884d-7f10fa928ffb', 'd2e5c690-94a3-4f6f-a6e7-1ccc3b150ebf', 'f015c213-3564-4f81-a7e5-c44fa0435f80', '2ee93e38-78d8-43c5-bbab-c68c5440cbcb'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:39.495952 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:39.564027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:39.638268 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:39.646195 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Deleted volume successfully.
Aug 27 21:20:39.683925 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-bf998f07-e88f-4df0-bf69-7be43dc22b06 tempest-SnapshotsActionsTest-394565177 None] Lock "cinder-f6a8c475-da78-47bf-a529-11a9c4d31b30-delete_volume" released by "delete_volume" :: held 0.746s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:40.204213 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=5 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:40.231428 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=56,cinder:UPDATE=24,cinder:INSERT=19,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:40.238552 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b33a4419-4440-4e1f-9077-504f6564d68a tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:40.866300 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b33a4419-4440-4e1f-9077-504f6564d68a tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:20:41.752040 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-74fe801e-4c6a-48ad-bc6d-abb34de6aeae tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:42.668717 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-74fe801e-4c6a-48ad-bc6d-abb34de6aeae tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:20:43.292037 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff676f3e-aa42-43f5-9728-efaf325eb58c tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:43.991232 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ff676f3e-aa42-43f5-9728-efaf325eb58c tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:20:44.214564 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-4c38a76d-aa90-4d19-8244-73582260249e-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:44.246393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-4c38a76d-aa90-4d19-8244-73582260249e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:44.251069 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:46.739973 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:46.773257 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Flow 'volume_create_manager' (95658b86-e36b-4eb7-8f68-0c2eacc70e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:46.787444 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da78b1da-317d-4dee-83ef-86fff4b97498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:46.824061 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da78b1da-317d-4dee-83ef-86fff4b97498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1156917488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3795433a-3039-411d-896d-62f018ad6191,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cc01aa6f5694bad92201ea520d6dedf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:47Z,use_quota=True,user_id='eb2957632a83469fb42889ccff532d3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebafc8cb-68f0-4232-a4e4-7cf15cc96847),volume_type_id=ebafc8cb-68f0-4232-a4e4-7cf15cc96847)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:46.840649 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bcab00-8f65-445e-b59f-2d039e644daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:46.853942 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2bcab00-8f65-445e-b59f-2d039e644daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:46.861861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf9917-d0ce-43d6-b573-79f7ab9d277f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:46.867815 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (becf9917-d0ce-43d6-b573-79f7ab9d277f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3795433a-3039-411d-896d-62f018ad6191', 'volume_name': 'volume-3795433a-3039-411d-896d-62f018ad6191', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:46.880462 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57e15e-cf43-410c-a960-7739b0236baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:46.887656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a57e15e-cf43-410c-a960-7739b0236baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:46.893327 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f134b34-bb9d-4fac-a4f3-30d4ca9d7dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:46.894510 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Volume 3795433a-3039-411d-896d-62f018ad6191: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3795433a-3039-411d-896d-62f018ad6191', 'volume_size': 1}
Aug 27 21:20:46.895620 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] creating volume 'volume-3795433a-3039-411d-896d-62f018ad6191' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:20:46.897156 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:47.014672 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:47.015493 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:47.019678 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f134b34-bb9d-4fac-a4f3-30d4ca9d7dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3795433a-3039-411d-896d-62f018ad6191', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:47.026917 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9c7895-1607-4379-9b05-92cf6c01c117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:47.041370 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Volume volume-3795433a-3039-411d-896d-62f018ad6191 (3795433a-3039-411d-896d-62f018ad6191): created successfully
Aug 27 21:20:47.061835 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9c7895-1607-4379-9b05-92cf6c01c117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:47.069177 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Flow 'volume_create_manager' (95658b86-e36b-4eb7-8f68-0c2eacc70e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:47.082731 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c88035ff-54b4-4937-8ed9-bdbd16dc8cfb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Created volume successfully.
Aug 27 21:20:48.399375 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91ec5957-f588-4572-b951-aede2af7db1b tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:48.481211 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91ec5957-f588-4572-b951-aede2af7db1b tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:48.543656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-91ec5957-f588-4572-b951-aede2af7db1b tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:48.556546 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-91ec5957-f588-4572-b951-aede2af7db1b tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Retype volume completed successfully.
Aug 27 21:20:49.548785 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Acquiring lock "cinder-3795433a-3039-411d-896d-62f018ad6191-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:49.567297 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Lock "cinder-3795433a-3039-411d-896d-62f018ad6191-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:49.651084 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:49.709051 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:49.710290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Volume volume-3795433a-3039-411d-896d-62f018ad6191 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:49.727312 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] deleting rbd volume volume-3795433a-3039-411d-896d-62f018ad6191 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:50.154647 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:20:50.161253 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:20:50.188091 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Created reservations ['3efcf624-e32d-4105-b8e9-d4730fc0614d', '0d5eb84b-90e8-4d97-937a-5808fd6db627', '4925632e-5eaf-4248-ade0-596d8c806729', '251b0c9a-88b9-476c-b31b-67e14be50e3d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:50.287073 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:50.360077 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:50.401699 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:50.408446 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Deleted volume successfully.
Aug 27 21:20:50.429709 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0ef0b2d5-9636-4cdc-99b1-ccf8ccba3bdb tempest-VolumeRetypeWithoutMigrationTest-368502414 None] Lock "cinder-3795433a-3039-411d-896d-62f018ad6191-delete_volume" released by "delete_volume" :: held 0.862s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:20:56.913179 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:20:56.942225 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Flow 'volume_create_manager' (d1d37a15-64ae-416a-ab1e-71dbcdee62fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:56.961149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1156924c-e798-4109-9404-b0b8720f5be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:56.994748 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1156924c-e798-4109-9404-b0b8720f5be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1141065195',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e211fdca-a037-4880-8e8d-b75e2b39db9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e54b13ca7078402a94d3410c970644ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:20:57Z,use_quota=True,user_id='051db9cde57c409a999bd86565a7547d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.008434 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec3bfba-0d29-4e94-8f80-295d33004bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:57.020809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec3bfba-0d29-4e94-8f80-295d33004bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.026194 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fca8cb-fb0c-4d69-a734-c833189dafc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:57.030371 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54fca8cb-fb0c-4d69-a734-c833189dafc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e211fdca-a037-4880-8e8d-b75e2b39db9d', 'volume_name': 'volume-e211fdca-a037-4880-8e8d-b75e2b39db9d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.045398 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b24cda6-aae7-41d8-af27-4b3e5c02ae8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:57.051640 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b24cda6-aae7-41d8-af27-4b3e5c02ae8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.057525 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e258f78-3dfb-42f7-ab1d-e2496e969312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:57.058712 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Volume e211fdca-a037-4880-8e8d-b75e2b39db9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e211fdca-a037-4880-8e8d-b75e2b39db9d', 'volume_size': 1}
Aug 27 21:20:57.059289 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] creating volume 'volume-e211fdca-a037-4880-8e8d-b75e2b39db9d' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:20:57.060428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:57.176818 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:20:57.177473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:20:57.181346 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e258f78-3dfb-42f7-ab1d-e2496e969312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e211fdca-a037-4880-8e8d-b75e2b39db9d', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.186185 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770d5b16-cf0e-4c8a-9c22-6b247d6ecb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:20:57.191043 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=58,cinder:INSERT=21,cinder:UPDATE=17,cinder:DELETE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:57.211185 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Volume volume-e211fdca-a037-4880-8e8d-b75e2b39db9d (e211fdca-a037-4880-8e8d-b75e2b39db9d): created successfully
Aug 27 21:20:57.224031 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770d5b16-cf0e-4c8a-9c22-6b247d6ecb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:20:57.241789 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Flow 'volume_create_manager' (d1d37a15-64ae-416a-ab1e-71dbcdee62fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:20:57.261674 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-65ad7ca2-8a7b-4243-94ac-62c9f5f05e35 tempest-VolumesServicesTestJSON-496083756 None] Created volume successfully.
Aug 27 21:20:58.145742 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Acquiring lock "cinder-e211fdca-a037-4880-8e8d-b75e2b39db9d-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:20:58.159181 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Lock "cinder-e211fdca-a037-4880-8e8d-b75e2b39db9d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:20:58.254648 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:58.352917 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:20:58.353762 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Volume volume-e211fdca-a037-4880-8e8d-b75e2b39db9d is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:20:58.370402 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] deleting rbd volume volume-e211fdca-a037-4880-8e8d-b75e2b39db9d {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:20:58.757931 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=58,cinder:DELETE=2,cinder:UPDATE=21,cinder:INSERT=19 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:20:58.801212 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Created reservations ['3d636f44-4804-4d75-a3e5-daacfbd971ee', '73092155-ab52-44d0-94ab-9594402a85a6', 'd92be928-d9ca-4af2-a235-51413a56ac1b', '975504e5-e391-454a-ab5a-22e847788c1d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:20:58.901496 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:58.989847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:20:59.071650 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:20:59.082284 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Deleted volume successfully.
Aug 27 21:20:59.118179 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-61d95859-4ee9-472b-86ab-6878a19fa6c1 tempest-VolumesServicesTestJSON-496083756 None] Lock "cinder-e211fdca-a037-4880-8e8d-b75e2b39db9d-delete_volume" released by "delete_volume" :: held 0.960s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:02.878231 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:21:02.879733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:02.956273 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:03.023122 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:21:05.184162 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:21:05.231142 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Flow 'volume_create_manager' (ca3cb542-a916-44bb-b2f6-5ac85780a90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:05.254759 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb07220d-38eb-4a10-94d8-32089146ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.294819 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb07220d-38eb-4a10-94d8-32089146ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:21:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-961869836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac651dd2aad4acbabdb04771505d315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:21:05Z,use_quota=True,user_id='3c85dcd919f14b80b3000a836c9039c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92d823ca-fcfc-44c5-85e2-8e9354ef5bd5),volume_type_id=92d823ca-fcfc-44c5-85e2-8e9354ef5bd5)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.320914 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da26a432-4d67-450e-9e07-ca23cd85b7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.325822 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da26a432-4d67-450e-9e07-ca23cd85b7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.331757 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480ab4c7-f25f-4e95-b445-1c47c20d74b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.336768 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480ab4c7-f25f-4e95-b445-1c47c20d74b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e', 'volume_name': 'volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.345166 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dc485a-b149-4aa2-b014-79b8230a1dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.352462 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83dc485a-b149-4aa2-b014-79b8230a1dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.357957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1806926e-4b0f-426b-94e5-77553e762d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.359851 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Volume 5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e', 'volume_size': 1}
Aug 27 21:21:05.360473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] creating volume 'volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:21:05.361497 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:05.502541 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:21:05.503195 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:21:05.507309 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1806926e-4b0f-426b-94e5-77553e762d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.514525 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cf11e7-592e-4d79-9234-0a072709a088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:05.530098 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Volume volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e (5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e): created successfully
Aug 27 21:21:05.536820 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cf11e7-592e-4d79-9234-0a072709a088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:05.551875 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Flow 'volume_create_manager' (ca3cb542-a916-44bb-b2f6-5ac85780a90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:05.571058 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c2b07e88-3829-4b0d-b8d2-88918b2e5b11 tempest-VolumeTypesTest-2116747480 None] Created volume successfully.
Aug 27 21:21:06.895909 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-949551b7-24a4-49fa-ad8b-f94a718e6ccf tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:06.941809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-949551b7-24a4-49fa-ad8b-f94a718e6ccf tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:06.991649 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-949551b7-24a4-49fa-ad8b-f94a718e6ccf tempest-VolumeTypesTest-2116747480 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:21:07.006229 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-949551b7-24a4-49fa-ad8b-f94a718e6ccf tempest-VolumeTypesTest-2116747480 None] Retype volume completed successfully.
Aug 27 21:21:09.191197 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Acquiring lock "cinder-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:09.213330 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Lock "cinder-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:09.261691 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:09.323992 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:21:09.324458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Volume volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:21:09.330767 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] deleting rbd volume volume-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:21:09.561420 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-787524089 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-787524089, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:21:09.562648 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-787524089 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-787524089, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:21:09.579825 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Created reservations ['66ad7e77-1353-494f-9ae4-6ee5af534d48', 'a8eed763-2d0e-4d5a-a3a4-ae8e2a645cdd', '5543d670-9a5c-427d-89fa-ef938d468f90', '89bff736-8838-492f-a1e4-68c0807b867f'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:09.649413 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:09.697406 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:09.766837 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:21:09.771112 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Deleted volume successfully.
Aug 27 21:21:09.795711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-ff794fd0-3164-483d-88ac-61d1f4f5528e tempest-VolumeTypesTest-2116747480 None] Lock "cinder-5c65b8dd-f4c1-45f1-8238-d4a2a0376a6e-delete_volume" released by "delete_volume" :: held 0.582s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:14.521445 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['b2b0393c-8323-43ae-80d2-fa6924eb0e0d', '8172cf29-07be-421c-9e13-23c9358213ec', '8836699a-c3e8-471d-a31f-44a9c6d2b59d', '200bf105-757a-4178-9827-ad34af5d8eb1'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:14.612780 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:21:14.630948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b32fb9f9-526f-42e6-8916-5e6a6953c7b2 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-4c38a76d-aa90-4d19-8244-73582260249e-delete_snapshot" released by "delete_snapshot" :: held 30.384s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:14.966585 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-f1982b1f-8b23-4b79-81cf-a6af562b910d-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:14.980901 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-f1982b1f-8b23-4b79-81cf-a6af562b910d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:14.986038 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:15.169232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:21:15.193485 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Flow 'volume_create_manager' (229a38a8-a6ce-4308-911e-69786134ecd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:15.200232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ef50e-610a-4e88-bc6c-5ceef3515a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.217164 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2ef50e-610a-4e88-bc6c-5ceef3515a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-877867013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=89f6b009-1dbd-4f2f-a487-86fa612909ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='703eb3ce86be4fc797e1ecda6700a6c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:21:15Z,use_quota=True,user_id='bc952b7f98604c6f9047c162693d3537',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.222947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c874bc29-c0ba-4c14-9a7b-7869f7315943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.228489 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c874bc29-c0ba-4c14-9a7b-7869f7315943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.234483 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262232c7-cac3-4c3f-abf0-a625b6bf9aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.238903 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262232c7-cac3-4c3f-abf0-a625b6bf9aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f6b009-1dbd-4f2f-a487-86fa612909ca', 'volume_name': 'volume-89f6b009-1dbd-4f2f-a487-86fa612909ca', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.244211 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc81fc0-988f-4f5b-917a-de35421beb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.248585 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc81fc0-988f-4f5b-917a-de35421beb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.265071 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756d2924-91a2-45b6-85ac-f0671971033b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.266372 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Volume 89f6b009-1dbd-4f2f-a487-86fa612909ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f6b009-1dbd-4f2f-a487-86fa612909ca', 'volume_size': 1}
Aug 27 21:21:15.267378 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] creating volume 'volume-89f6b009-1dbd-4f2f-a487-86fa612909ca' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:21:15.268841 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:15.391519 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:21:15.391519 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:21:15.395401 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756d2924-91a2-45b6-85ac-f0671971033b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f6b009-1dbd-4f2f-a487-86fa612909ca', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.401309 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600704e-e75a-4ce8-bdca-7f4ed7a02b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:15.414614 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Volume volume-89f6b009-1dbd-4f2f-a487-86fa612909ca (89f6b009-1dbd-4f2f-a487-86fa612909ca): created successfully
Aug 27 21:21:15.419858 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600704e-e75a-4ce8-bdca-7f4ed7a02b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:15.426845 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Flow 'volume_create_manager' (229a38a8-a6ce-4308-911e-69786134ecd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:15.442414 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ee2a269c-02c7-435c-8ce0-fc905448c4f6 tempest-SnapshotMetadataTestJSON-1707382132 None] Created volume successfully.
Aug 27 21:21:16.497472 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=61,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:21:16.537678 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f076dc37-af02-42ed-aa9e-0f5d45355749 tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:16.857098 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f076dc37-af02-42ed-aa9e-0f5d45355749 tempest-SnapshotMetadataTestJSON-1707382132 None] Create snapshot completed successfully
Aug 27 21:21:18.447947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] Acquiring lock "cinder-88121c53-6a6d-48e8-ad82-0efed85ba1dc-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:18.461846 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] Lock "cinder-88121c53-6a6d-48e8-ad82-0efed85ba1dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:18.468199 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:18.864306 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] Created reservations ['a7499a84-3961-4bb8-a536-9b925dd34972', '0ef5e193-7e6d-4550-8f69-918ffae472dc', '0d7b120f-6696-482d-a36a-ff4a139549a7', 'dbc0c87c-410b-461a-ba53-655249665bd9'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:18.874078 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=32,cinder:SELECT=59,cinder:DELETE=3,cinder:INSERT=6 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:21:18.954943 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] Delete snapshot completed successfully.
Aug 27 21:21:18.965136 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-e8b4cc38-6061-4e17-9858-4e522d7de74d tempest-SnapshotMetadataTestJSON-1707382132 None] Lock "cinder-88121c53-6a6d-48e8-ad82-0efed85ba1dc-delete_snapshot" released by "delete_snapshot" :: held 0.503s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:19.630847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Acquiring lock "cinder-89f6b009-1dbd-4f2f-a487-86fa612909ca-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:19.667372 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Lock "cinder-89f6b009-1dbd-4f2f-a487-86fa612909ca-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:19.716540 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:19.794513 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:21:19.794947 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Volume volume-89f6b009-1dbd-4f2f-a487-86fa612909ca is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:21:19.813249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] deleting rbd volume volume-89f6b009-1dbd-4f2f-a487-86fa612909ca {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:21:20.196214 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Created reservations ['fad41841-6bd9-4a6b-b80b-a38f4bcd179f', '82c2e334-b3e3-47dc-ba29-6ffe44e9c4ea', 'ea0a7d46-f81a-4475-8c34-bb780a7593cc', 'a2e1df51-9076-485f-9b33-7b1b108e68b9'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:20.279819 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:20.355797 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:20.421998 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:21:20.430972 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Deleted volume successfully.
Aug 27 21:21:20.458387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-73e3b6fa-b3eb-4528-a140-979399388c7a tempest-SnapshotMetadataTestJSON-1707382132 None] Lock "cinder-89f6b009-1dbd-4f2f-a487-86fa612909ca-delete_volume" released by "delete_volume" :: held 0.791s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:25.659757 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:21:25.697325 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Flow 'volume_create_manager' (18345559-65f1-46e0-8bde-9136f85570f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:25.708510 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8141f93-439c-45e5-a967-3336b2d4c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.740193 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8141f93-439c-45e5-a967-3336b2d4c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1149143575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=100a2f0f-c555-4f5e-b201-f416c7f8bd55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='087b767d573744f89257a87acd5ec965',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:21:26Z,use_quota=True,user_id='563a41416f4b4a6797ead1377f88786b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.760253 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa07dec-f8a4-4bd7-bc28-3bd3f2c732eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.768459 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fa07dec-f8a4-4bd7-bc28-3bd3f2c732eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.782788 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4c8d7f-596a-4214-9ebf-59a135de3f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.792858 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4c8d7f-596a-4214-9ebf-59a135de3f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100a2f0f-c555-4f5e-b201-f416c7f8bd55', 'volume_name': 'volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.800159 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559943c2-61d7-4184-abeb-9d2199858006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.804968 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559943c2-61d7-4184-abeb-9d2199858006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.810448 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a4fae3-d972-430b-a77f-0f7ff301a37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.812900 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Volume 100a2f0f-c555-4f5e-b201-f416c7f8bd55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55', 'volume_size': 1}
Aug 27 21:21:25.813579 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] creating volume 'volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:21:25.814608 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:25.935479 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:21:25.936222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:21:25.940075 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a4fae3-d972-430b-a77f-0f7ff301a37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.944773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65848d6d-d33f-4956-a2d2-63d65d4c48a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:25.954876 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Volume volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55 (100a2f0f-c555-4f5e-b201-f416c7f8bd55): created successfully
Aug 27 21:21:25.959329 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65848d6d-d33f-4956-a2d2-63d65d4c48a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:25.965817 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Flow 'volume_create_manager' (18345559-65f1-46e0-8bde-9136f85570f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:25.980400 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-959c1101-74d6-49eb-8719-ffe7c7c9601f tempest-VolumesDeleteCascade-600040362 None] Created volume successfully.
Aug 27 21:21:27.095005 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a2465d1b-0565-4e8e-a4c6-a0741b57ced2 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:27.714016 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a2465d1b-0565-4e8e-a4c6-a0741b57ced2 tempest-VolumesDeleteCascade-600040362 None] Create snapshot completed successfully
Aug 27 21:21:28.391478 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e9d3bd00-cd41-4914-bea7-dee5dc046e1d tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:28.763511 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e9d3bd00-cd41-4914-bea7-dee5dc046e1d tempest-VolumesDeleteCascade-600040362 None] Create snapshot completed successfully
Aug 27 21:21:29.501469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Acquiring lock "cinder-100a2f0f-c555-4f5e-b201-f416c7f8bd55-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:29.516269 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-100a2f0f-c555-4f5e-b201-f416c7f8bd55-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:29.601561 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Performing cascade delete. {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}}
Aug 27 21:21:29.617603 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Acquiring lock "cinder-6b3b098a-1f07-4e4e-a73d-bd32a02a3fac-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:29.628659 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-6b3b098a-1f07-4e4e-a73d-bd32a02a3fac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:29.658289 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:30.884412 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Created reservations ['caeb7194-3bf1-4626-8fd2-81bbd8740624', '8b91c9e5-dad2-420f-ab77-0238e582958e', 'daf4dccf-9c54-4cce-be5d-193d38c7c5a0', '841ab29d-b50f-4e05-acd5-d784ba27d55a'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:30.973584 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Delete snapshot completed successfully.
Aug 27 21:21:30.980036 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-6b3b098a-1f07-4e4e-a73d-bd32a02a3fac-delete_snapshot" released by "delete_snapshot" :: held 1.351s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:30.981238 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Acquiring lock "cinder-7810948a-7fbb-474d-9299-3313cbefa032-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:30.992527 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-7810948a-7fbb-474d-9299-3313cbefa032-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:31.017362 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:31.861238 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Created reservations ['d128ea4d-619e-4165-a2b1-e25a0cab422e', 'adbf72dc-ae61-40d2-8917-f368001e0b8e', '25b5f7ad-5906-4159-8d48-431aed52452e', 'a007b18a-cea0-4d62-aef3-6148694e32ab'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:31.871551 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=59,cinder:DELETE=4,cinder:INSERT=8,cinder:UPDATE=29 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:21:31.932107 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Delete snapshot completed successfully.
Aug 27 21:21:31.938067 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-7810948a-7fbb-474d-9299-3313cbefa032-delete_snapshot" released by "delete_snapshot" :: held 0.945s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:31.938773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Snapshots deleted, issuing volume delete {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}}
Aug 27 21:21:31.939792 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:32.008598 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:21:32.009027 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Volume volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:21:32.018428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] deleting rbd volume volume-100a2f0f-c555-4f5e-b201-f416c7f8bd55 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:21:32.337806 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=63,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:21:32.382979 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Created reservations ['3b93922c-bf30-4a5f-824d-efe84c72e2cc', '11845000-c138-4825-aad8-7af8a309b045', '4e72044a-dff3-4d9f-960c-3b3a91083433', 'd9261a32-6c66-419e-b147-f948b83e4e39'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:32.465698 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:32.538277 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:32.616081 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:21:32.622021 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Deleted volume successfully.
Aug 27 21:21:32.647740 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-05a9dd06-844b-48cd-b75d-afe85f5f8e16 tempest-VolumesDeleteCascade-600040362 None] Lock "cinder-100a2f0f-c555-4f5e-b201-f416c7f8bd55-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:45.331656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['9cbb361e-8d3a-4334-8c06-7e26426e2970', '52f7b67b-f333-41d5-9650-647e342e4534', 'd4911f97-7516-414b-98e4-15a0f8621503', '981bd462-6322-4c19-a52c-f855faab82ca'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:21:45.408667 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:21:45.421052 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9b4d96f2-ef6c-429d-a29f-8e320b8756f4 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-f1982b1f-8b23-4b79-81cf-a6af562b910d-delete_snapshot" released by "delete_snapshot" :: held 30.440s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:21:45.653951 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-a04122b6-5d68-4416-9c03-275e8ce34c3e-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:21:45.686537 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-a04122b6-5d68-4416-9c03-275e8ce34c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:21:45.694524 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:55.402755 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=21,cinder:INSERT=5,cinder:UPDATE=13 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:21:57.722150 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:21:57.751210 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (7d9a4564-a37c-4a72-adba-0130822c1cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:57.769764 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1ab7cb-3c23-4ccc-9f3f-229f5bcd155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.787636 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1ab7cb-3c23-4ccc-9f3f-229f5bcd155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1277630902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6ce39b79-2e72-41ef-9a31-70cd74ac0819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1af0bf8af3d4939a02ed68761de3426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:21:58Z,use_quota=True,user_id='7a6f1f079b594953b34352017d68f85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.793945 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ca5ce4-d387-4674-8343-3be225a26342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.798358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ca5ce4-d387-4674-8343-3be225a26342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.803606 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de67c8c1-76ae-4927-9f9a-0247d4e1ae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.807928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de67c8c1-76ae-4927-9f9a-0247d4e1ae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce39b79-2e72-41ef-9a31-70cd74ac0819', 'volume_name': 'volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.813444 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170cafae-a503-4c7e-9d89-44c52010ff61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.817428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170cafae-a503-4c7e-9d89-44c52010ff61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.822105 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c786928a-481c-4580-a11f-74f2fe327714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.823272 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Volume 6ce39b79-2e72-41ef-9a31-70cd74ac0819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819', 'volume_size': 1}
Aug 27 21:21:57.823622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] creating volume 'volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:21:57.824477 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:57.924885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:21:57.924885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:21:57.924885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c786928a-481c-4580-a11f-74f2fe327714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.929925 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee3447a-54e7-4d28-b807-82063ca0cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:57.942065 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819 (6ce39b79-2e72-41ef-9a31-70cd74ac0819): created successfully
Aug 27 21:21:57.946310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee3447a-54e7-4d28-b807-82063ca0cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:57.952806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (7d9a4564-a37c-4a72-adba-0130822c1cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:57.965909 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d8733f49-aa9b-4ca6-9186-67cf553684e8 tempest-VolumesListAdminTestJSON-580720804 None] Created volume successfully.
Aug 27 21:21:59.338458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:21:59.362336 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (80af073b-6e0b-4d12-8eec-7ac434bfca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:59.369709 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629ec2-f740-4049-b787-d59dc7454257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.388793 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba629ec2-f740-4049-b787-d59dc7454257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-493147557',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=882ece7b-8198-43da-8c29-96e10adba823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1af0bf8af3d4939a02ed68761de3426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:21:59Z,use_quota=True,user_id='7a6f1f079b594953b34352017d68f85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.394597 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88a9c40-fa07-4785-84bf-1009140509bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.399316 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e88a9c40-fa07-4785-84bf-1009140509bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.404506 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b0275c-eb62-41ac-b08e-a3def1644278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.409442 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b0275c-eb62-41ac-b08e-a3def1644278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882ece7b-8198-43da-8c29-96e10adba823', 'volume_name': 'volume-882ece7b-8198-43da-8c29-96e10adba823', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.414723 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab6d98a-8e63-420a-9282-f1e98c4f8d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.418572 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab6d98a-8e63-420a-9282-f1e98c4f8d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.423373 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e47a4b0-142d-4698-a886-f536ecbb3d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.424693 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Volume 882ece7b-8198-43da-8c29-96e10adba823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882ece7b-8198-43da-8c29-96e10adba823', 'volume_size': 1}
Aug 27 21:21:59.425233 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] creating volume 'volume-882ece7b-8198-43da-8c29-96e10adba823' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:21:59.430777 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:21:59.531830 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:21:59.532658 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:21:59.541520 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e47a4b0-142d-4698-a886-f536ecbb3d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882ece7b-8198-43da-8c29-96e10adba823', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.549480 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df2fe7d-6c22-4e22-9ac2-bf3ac0ec3289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:21:59.565339 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-882ece7b-8198-43da-8c29-96e10adba823 (882ece7b-8198-43da-8c29-96e10adba823): created successfully
Aug 27 21:21:59.570025 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8df2fe7d-6c22-4e22-9ac2-bf3ac0ec3289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:21:59.584583 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (80af073b-6e0b-4d12-8eec-7ac434bfca35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:21:59.600549 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2c4781dc-6ffa-4d4a-898e-6b648cabfe73 tempest-VolumesListAdminTestJSON-580720804 None] Created volume successfully.
Aug 27 21:22:00.904157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:00.931044 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (48a3daab-6658-4774-ada9-9506dfa86474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:00.962374 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e23275e-6df9-44f7-b6e8-a030dcdcd846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.002135 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e23275e-6df9-44f7-b6e8-a030dcdcd846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1526660064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6084cf6-e5b5-401b-9b51-4f3896c9e262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1af0bf8af3d4939a02ed68761de3426',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:01Z,use_quota=True,user_id='7a6f1f079b594953b34352017d68f85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.020604 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697b779b-8dc2-41c6-888b-f4a11c7a3aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.031387 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697b779b-8dc2-41c6-888b-f4a11c7a3aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.045638 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2166f8-def8-4087-ac56-358a348fd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.056739 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f2166f8-def8-4087-ac56-358a348fd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6084cf6-e5b5-401b-9b51-4f3896c9e262', 'volume_name': 'volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.070145 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cccb341-0c3a-4694-8721-bcff11709cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.074812 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cccb341-0c3a-4694-8721-bcff11709cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.080913 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e0cbe9-26b2-4e18-903a-a5ae95fca615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.082266 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Volume e6084cf6-e5b5-401b-9b51-4f3896c9e262: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262', 'volume_size': 1}
Aug 27 21:22:01.082809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] creating volume 'volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:22:01.083841 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:01.180199 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:01.180848 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:01.184779 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e0cbe9-26b2-4e18-903a-a5ae95fca615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.190773 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c4175a-5633-47a9-8a14-08e73d27996e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:01.200462 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262 (e6084cf6-e5b5-401b-9b51-4f3896c9e262): created successfully
Aug 27 21:22:01.204733 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c4175a-5633-47a9-8a14-08e73d27996e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:01.210515 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Flow 'volume_create_manager' (48a3daab-6658-4774-ada9-9506dfa86474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:01.221721 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-edf0d239-2c2a-4025-a4e2-809907ab55b1 tempest-VolumesListAdminTestJSON-580720804 None] Created volume successfully.
Aug 27 21:22:02.534045 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=33,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:02.541783 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:02.568110 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Flow 'volume_create_manager' (c86c43c5-9d07-4e75-b8aa-fb721ae1c0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:02.577664 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafe3706-9e56-48cd-a37d-23bd535d1310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.597630 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafe3706-9e56-48cd-a37d-23bd535d1310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=343c25e3-92b8-4083-a680-968fd63e289b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861a21f8cb7e4a4ca9dd3bbd3b526015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:02Z,use_quota=True,user_id='27b881d2b70246338e4cfabd20514362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.603972 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b844978-df8e-4935-975a-310da8143877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.608317 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b844978-df8e-4935-975a-310da8143877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.614443 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b9c6ad-ddad-4d18-8a77-5981ff5401bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.619409 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b9c6ad-ddad-4d18-8a77-5981ff5401bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '343c25e3-92b8-4083-a680-968fd63e289b', 'volume_name': 'volume-343c25e3-92b8-4083-a680-968fd63e289b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.626177 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d69d22a-3652-4172-825a-0858a9279ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.630843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d69d22a-3652-4172-825a-0858a9279ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.637077 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd8a3b2-69f1-41e6-b91d-9c6eecf22baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.638813 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Volume 343c25e3-92b8-4083-a680-968fd63e289b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-343c25e3-92b8-4083-a680-968fd63e289b', 'volume_size': 1}
Aug 27 21:22:02.639494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] creating volume 'volume-343c25e3-92b8-4083-a680-968fd63e289b' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:22:02.640427 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:02.730054 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:02.730551 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:02.737778 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebd8a3b2-69f1-41e6-b91d-9c6eecf22baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-343c25e3-92b8-4083-a680-968fd63e289b', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.742577 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe0186b-17d8-4280-88d4-e06bc0b5cb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:02.755728 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Volume volume-343c25e3-92b8-4083-a680-968fd63e289b (343c25e3-92b8-4083-a680-968fd63e289b): created successfully
Aug 27 21:22:02.761192 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe0186b-17d8-4280-88d4-e06bc0b5cb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:02.769885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Flow 'volume_create_manager' (c86c43c5-9d07-4e75-b8aa-fb721ae1c0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:02.780866 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-87e143b3-53e8-46a7-af74-171c10a1312e tempest-VolumesListAdminTestJSON-1204066799 None] Created volume successfully.
Aug 27 21:22:02.878665 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:22:02.879484 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:02.943849 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:03.003328 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:03.791163 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Acquiring lock "cinder-343c25e3-92b8-4083-a680-968fd63e289b-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:03.813867 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Lock "cinder-343c25e3-92b8-4083-a680-968fd63e289b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:03.856698 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:03.940913 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:03.941343 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Volume volume-343c25e3-92b8-4083-a680-968fd63e289b is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:03.953134 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] deleting rbd volume volume-343c25e3-92b8-4083-a680-968fd63e289b {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:03.959096 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Acquiring lock "cinder-e6084cf6-e5b5-401b-9b51-4f3896c9e262-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:03.984157 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-e6084cf6-e5b5-401b-9b51-4f3896c9e262-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:04.041615 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:04.123925 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:04.124599 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:04.131521 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] deleting rbd volume volume-e6084cf6-e5b5-401b-9b51-4f3896c9e262 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:04.345322 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Created reservations ['a2bc9257-9c2c-4c5e-a89a-ed49c1ededa4', '81d16a72-6973-4691-9b59-6e2146e580ce', 'c1384d01-45ee-448a-84ce-9904bdf1c652', '832fdb2c-9709-4b08-a79c-f673a2814373'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:04.454651 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:04.503512 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:04.557026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:04.566891 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Deleted volume successfully.
Aug 27 21:22:04.594182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Created reservations ['3c05c4c1-c447-4df2-bdee-996c8f458f1e', '2008eb62-77db-4a4f-b67e-a16589e69aaa', 'ad67eee0-b018-4f95-92f4-69afcc3ceec6', '33d3ad02-81fa-4ad8-8e08-a3ab7e4bd151'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:04.603883 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-2b002a7f-ddff-408b-8852-0836703dfedf tempest-VolumesListAdminTestJSON-1204066799 None] Lock "cinder-343c25e3-92b8-4083-a680-968fd63e289b-delete_volume" released by "delete_volume" :: held 0.790s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:04.692599 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:04.747806 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:04.796469 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:04.810939 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Deleted volume successfully.
Aug 27 21:22:04.832069 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-36e02a75-b2c9-4d12-a199-b3462266c362 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-e6084cf6-e5b5-401b-9b51-4f3896c9e262-delete_volume" released by "delete_volume" :: held 0.849s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:05.121645 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Acquiring lock "cinder-882ece7b-8198-43da-8c29-96e10adba823-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:05.132740 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-882ece7b-8198-43da-8c29-96e10adba823-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:05.191710 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:05.244592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:05.245308 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-882ece7b-8198-43da-8c29-96e10adba823 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:05.254252 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] deleting rbd volume volume-882ece7b-8198-43da-8c29-96e10adba823 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:05.529138 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Created reservations ['437b9689-95ec-45c3-beea-626ac37d47e2', '4ce90c5b-8a62-48a8-ae52-b78e4babe942', 'fba2c604-9243-4a3b-b854-abf20746ae30', '1bcb27d8-fd3a-4f7d-a34b-bb1f2326d714'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:05.599158 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:05.652125 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:05.690993 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:05.695424 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Deleted volume successfully.
Aug 27 21:22:05.716766 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-8c122062-7828-4f38-97c1-bddcd1b55db6 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-882ece7b-8198-43da-8c29-96e10adba823-delete_volume" released by "delete_volume" :: held 0.584s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:06.303720 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Acquiring lock "cinder-6ce39b79-2e72-41ef-9a31-70cd74ac0819-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:06.322360 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-6ce39b79-2e72-41ef-9a31-70cd74ac0819-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:06.369522 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:06.465697 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:06.466861 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Volume volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:06.473166 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] deleting rbd volume volume-6ce39b79-2e72-41ef-9a31-70cd74ac0819 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:06.706297 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=60,cinder:UPDATE=34,cinder:DELETE=2,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:06.745705 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Created reservations ['2a9f9e8e-f74d-4c11-890e-816fb288d18d', 'd86ca8c1-fb42-4d62-8ce7-081998dbb81e', '3e4bc84c-f759-4413-9b9b-4245f49cd2cc', 'a5869eb9-8211-4785-9cbd-23c363d4a90b'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:06.823382 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:06.887523 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:06.940090 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:06.966838 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Deleted volume successfully.
Aug 27 21:22:06.992881 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c139b0b2-594f-42e3-8dab-1f79c3b6eca1 tempest-VolumesListAdminTestJSON-580720804 None] Lock "cinder-6ce39b79-2e72-41ef-9a31-70cd74ac0819-delete_volume" released by "delete_volume" :: held 0.670s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:11.208045 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:11.242985 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Flow 'volume_create_manager' (38643837-5b9b-4228-904f-3be4a9fbdebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:11.251409 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31af54-7de2-4d22-99f8-3cfbbb4b25e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:11.269973 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d31af54-7de2-4d22-99f8-3cfbbb4b25e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1532761808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=92be5e0e-d9fe-4901-b702-4f80476540da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed8fd23ec27d484893aa0c23799400e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:11Z,use_quota=True,user_id='e4f8916aee824d948123717a7d7e7db7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:11.276807 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3625dd-6a6c-49a7-8987-ffdddd75c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:11.281634 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3625dd-6a6c-49a7-8987-ffdddd75c694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:11.288670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9e1cb1-a0da-4eb7-b46b-1605d4acd2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:11.323226 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=51,cinder:UPDATE=34,cinder:INSERT=12,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:11.416552 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd9e1cb1-a0da-4eb7-b46b-1605d4acd2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '92be5e0e-d9fe-4901-b702-4f80476540da', 'volume_name': 'volume-92be5e0e-d9fe-4901-b702-4f80476540da', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4bd310>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:11.422180 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bf8831-6649-4e3c-be32-d70fbd4bad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:11.426390 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9bf8831-6649-4e3c-be32-d70fbd4bad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:11.443370 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88f11d-7ced-46f5-836a-26d768e28f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:11.446666 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Volume 92be5e0e-d9fe-4901-b702-4f80476540da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-92be5e0e-d9fe-4901-b702-4f80476540da', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4bd310>}
Aug 27 21:22:11.447564 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Cloning 92be5e0e-d9fe-4901-b702-4f80476540da from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:22:11.448556 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:11.470858 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:11.492410 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 22, 11, 475668)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:22:11.493229 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:22:11.493854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:22:11.498287 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:11.499279 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:22:11.517996 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 22, 11, 503638)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:22:11.518414 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:22:11.518854 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:22:11.533749 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:11.619685 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] creating snapshot='volume-92be5e0e-d9fe-4901-b702-4f80476540da.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:22:11.829409 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-92be5e0e-d9fe-4901-b702-4f80476540da.clone_snap' to 'volume-92be5e0e-d9fe-4901-b702-4f80476540da' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:22:12.026264 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:12.028631 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:12.029275 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:12.050267 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:22:12.052756 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Marking volume 92be5e0e-d9fe-4901-b702-4f80476540da as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:22:12.063847 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to 92be5e0e-d9fe-4901-b702-4f80476540da. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:22:12.065074 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Creating volume glance metadata for volume 92be5e0e-d9fe-4901-b702-4f80476540da backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:22:12.128932 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be88f11d-7ced-46f5-836a-26d768e28f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92be5e0e-d9fe-4901-b702-4f80476540da', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac4bd310>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:12.138646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e86fc7-8c99-4853-98dc-1d0a44ca8bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:12.155459 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Volume volume-92be5e0e-d9fe-4901-b702-4f80476540da (92be5e0e-d9fe-4901-b702-4f80476540da): created successfully
Aug 27 21:22:12.160949 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e86fc7-8c99-4853-98dc-1d0a44ca8bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:12.167632 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Flow 'volume_create_manager' (38643837-5b9b-4228-904f-3be4a9fbdebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:12.179317 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c29b60ab-a244-4a00-b42f-a9f92d560d05 tempest-VolumesImageMetadata-1339294524 None] Created volume successfully.
Aug 27 21:22:13.636411 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Acquiring lock "cinder-92be5e0e-d9fe-4901-b702-4f80476540da-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:13.651661 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Lock "cinder-92be5e0e-d9fe-4901-b702-4f80476540da-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:13.713833 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:13.829450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:13.843537 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] deleting rbd volume volume-92be5e0e-d9fe-4901-b702-4f80476540da {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:14.142731 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:22:14.194024 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] deleting parent snapshot volume-92be5e0e-d9fe-4901-b702-4f80476540da.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:22:14.969915 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Created reservations ['adb1ade6-f27c-46bf-8773-619f8e05806e', '65ebfd83-ef22-4d42-a29e-05939d849f91', 'fc36614a-fd73-4bc2-97b1-659b01e38b4e', '8e970eec-38fd-41cc-a99a-db877eb90dad'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:15.041056 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:15.089935 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:15.143970 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:15.150133 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Deleted volume successfully.
Aug 27 21:22:15.176264 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1840e037-22db-4ae0-bf22-d4f289a408ab tempest-VolumesImageMetadata-1339294524 None] Lock "cinder-92be5e0e-d9fe-4901-b702-4f80476540da-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:16.077422 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['79153656-f6b9-44c6-826e-d310506f67bf', 'b17e535b-22d1-4cb4-9abc-42391da5aa57', 'e9928852-8898-4727-bf93-61ad64e3dc82', 'a8f9c02f-a672-4d9b-985c-31faba92cd96'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:16.158810 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:22:16.174188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-b6013a23-f3cb-4875-95fd-5e6ae1b740fc tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-a04122b6-5d68-4416-9c03-275e8ce34c3e-delete_snapshot" released by "delete_snapshot" :: held 30.488s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:17.409023 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-a716bb33-04e7-453a-972a-c026dbfbb4f4 req-f34c93c1-2bea-42e9-845c-3ca9e35afa10 tempest-VolumesSnapshotTestJSON-104348141 None] Terminate volume connection completed successfully.
Aug 27 21:22:17.410221 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-a716bb33-04e7-453a-972a-c026dbfbb4f4 req-f34c93c1-2bea-42e9-845c-3ca9e35afa10 tempest-VolumesSnapshotTestJSON-104348141 None] Deleting attachment 4d41825b-8987-4a65-8c0b-0847e290042b. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:22:20.126016 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:20.155577 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (0a57ecc5-2180-49da-900c-ed13e89ad682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:20.162150 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba57adbd-b251-454d-9337-6f95d18e8904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:20.181096 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba57adbd-b251-454d-9337-6f95d18e8904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1590832297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ddd692f04942778ad7ca8d9218ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:20Z,use_quota=True,user_id='2c735c8206584de58a0d85fa33ee2c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:20.187653 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a295d8d-3b12-407b-82b4-065d38467598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:20.192188 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a295d8d-3b12-407b-82b4-065d38467598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:20.198000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272e641-951b-4a82-b653-64ce73ac3b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:20.371595 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4272e641-951b-4a82-b653-64ce73ac3b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'volume_name': 'volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac48d5e0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:20.378621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011f7e91-4abd-49b4-bff9-c349600c85d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:20.383674 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (011f7e91-4abd-49b4-bff9-c349600c85d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:20.407551 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa14d05-c738-4042-abe3-6c89a836070a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:20.409010 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Volume d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac48d5e0>}
Aug 27 21:22:20.409946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Cloning d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:22:20.410775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:20.426413 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:20.449516 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 22, 20, 436780)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:22:20.451622 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:22:20.453059 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:22:20.459177 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:20.460816 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:22:20.469535 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 22, 20, 465434)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:22:20.471840 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:22:20.472610 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:22:20.490989 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:20.574310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] creating snapshot='volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:22:21.021038 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd.clone_snap' to 'volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:22:21.243592 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:21.246248 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:21.247513 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:21.290910 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:22:21.291774 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Marking volume d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:22:21.330834 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Copying metadata from image 3c9ca970-c391-4d4a-9934-78cc80446a1e to d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 27 21:22:21.332245 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Creating volume glance metadata for volume d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd backed by image 3c9ca970-c391-4d4a-9934-78cc80446a1e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=133391) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 27 21:22:21.416032 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa14d05-c738-4042-abe3-6c89a836070a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac48d5e0>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:21.429934 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabecca3-8024-4531-b7c7-25ea1dc6ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:21.452943 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Volume volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd (d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd): created successfully
Aug 27 21:22:21.457580 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabecca3-8024-4531-b7c7-25ea1dc6ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:21.464471 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (0a57ecc5-2180-49da-900c-ed13e89ad682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:21.476286 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a472047f-47f7-492b-bda7-9fbc29d8a84f tempest-VolumesCloneTest-625286051 None] Created volume successfully.
Aug 27 21:22:22.507987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-912cf45d-ff56-4a9f-a862-9bc087624b90 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:23.185182 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=25,cinder:SELECT=59,cinder:DELETE=2,cinder:INSERT=14 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:23.200518 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=60,cinder:UPDATE=20,cinder:INSERT=18,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:23.212926 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:23.248242 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (bc9c7b06-dc41-490b-90bd-d600d84cd095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:23.254563 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fa18a8-cbec-44c1-ae10-c14b0d64d2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:23.271635 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09fa18a8-cbec-44c1-ae10-c14b0d64d2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-729839031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b66117ff-b0b8-41b8-9d35-54c1a54e6cf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ddd692f04942778ad7ca8d9218ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:23Z,use_quota=True,user_id='2c735c8206584de58a0d85fa33ee2c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:23.280450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6112ef-ffcf-46f8-bb8f-b50fa9cfbb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:23.284577 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e6112ef-ffcf-46f8-bb8f-b50fa9cfbb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:23.289531 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7d537c-a556-4fba-9fed-77ce48e6b463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:23.307041 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee7d537c-a556-4fba-9fed-77ce48e6b463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b66117ff-b0b8-41b8-9d35-54c1a54e6cf7', 'volume_name': 'volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7', 'volume_size': 1, 'source_volid': 'd03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'source_volstatus': 'available'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:23.312346 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca3dac0-d156-428b-8139-9bf05d6e98a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:23.316211 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dca3dac0-d156-428b-8139-9bf05d6e98a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:23.320753 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e708999-142d-43ae-a268-85c36f174e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:23.321813 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Volume b66117ff-b0b8-41b8-9d35-54c1a54e6cf7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7', 'volume_size': 1, 'source_volid': 'd03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'source_volstatus': 'available'}
Aug 27 21:22:23.338055 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:23.435893 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] creating snapshot='volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:22:23.666167 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] cloning 'volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd@volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7.clone_snap' to 'volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:22:23.752020 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-912cf45d-ff56-4a9f-a862-9bc087624b90 tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:22:23.926232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Volume volume-0e3b6613-4290-42c9-9b9f-bdced8970206.deleted is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:23.928701 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:23.928889 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:23.972441 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:22:23.973296 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.volume_utils [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Marking volume b66117ff-b0b8-41b8-9d35-54c1a54e6cf7 as bootable. {{(pid=133391) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 27 21:22:23.986009 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Copying metadata from source volume d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd to b66117ff-b0b8-41b8-9d35-54c1a54e6cf7. {{(pid=133391) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Aug 27 21:22:24.021588 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e708999-142d-43ae-a268-85c36f174e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7', 'volume_size': 1, 'source_volid': 'd03b7fc4-0696-4f43-ac3b-1ab1a5048ddd', 'source_volstatus': 'available'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.026636 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ceffff-e4d0-4f30-8b53-54a14943c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.045061 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Volume volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7 (b66117ff-b0b8-41b8-9d35-54c1a54e6cf7): created successfully
Aug 27 21:22:24.051647 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ceffff-e4d0-4f30-8b53-54a14943c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.057358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (bc9c7b06-dc41-490b-90bd-d600d84cd095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:24.073828 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9d53985c-db20-418f-bcc4-c8b27a769651 tempest-VolumesCloneTest-625286051 None] Created volume successfully.
Aug 27 21:22:24.785011 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:24.835473 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (a804dc61-b025-40c7-b5d6-f98ffa71288d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:24.858292 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfae82a-99d8-406e-97c1-2428d8963796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.886912 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bfae82a-99d8-406e-97c1-2428d8963796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1845112464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f1a6f30-d053-49c4-adf4-dcf9256c1606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ddd692f04942778ad7ca8d9218ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:25Z,use_quota=True,user_id='2c735c8206584de58a0d85fa33ee2c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.900152 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7572d5-4728-4d1f-a314-2aabbe1bead6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.906891 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d7572d5-4728-4d1f-a314-2aabbe1bead6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.913785 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317b541-488e-4ea2-8de7-c9bc9a732501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.919605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317b541-488e-4ea2-8de7-c9bc9a732501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'volume_name': 'volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.926670 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadf1ba4-96f0-42e5-8ae3-04fa6d4aa3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.930870 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aadf1ba4-96f0-42e5-8ae3-04fa6d4aa3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:24.936249 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef588277-fb45-4a40-9405-9b33b3e7d33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:24.937762 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Volume 3f1a6f30-d053-49c4-adf4-dcf9256c1606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'volume_size': 1}
Aug 27 21:22:24.938329 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] creating volume 'volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:22:24.939450 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:24.991295 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-2301d0fc-8781-4316-bb8f-49201d5d4729-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:25.009126 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-2301d0fc-8781-4316-bb8f-49201d5d4729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:25.029320 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:25.130201 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:25.130201 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:25.140924 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef588277-fb45-4a40-9405-9b33b3e7d33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:25.147108 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9882bef-3082-4d8e-a72e-5c229e3a29ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:25.162293 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Volume volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606 (3f1a6f30-d053-49c4-adf4-dcf9256c1606): created successfully
Aug 27 21:22:25.171841 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9882bef-3082-4d8e-a72e-5c229e3a29ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:25.182633 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (a804dc61-b025-40c7-b5d6-f98ffa71288d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:25.197431 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-c559f669-a9c5-4200-8679-aa675a5c1025 tempest-VolumesCloneTest-625286051 None] Created volume successfully.
Aug 27 21:22:25.786334 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['20a46ad4-d978-473b-a170-f7a3f50ef72c', '32b037c2-19b5-452d-b3be-f72322b69062', '9cead18a-88cb-40a9-b8ae-d611f6e98cac', 'e8553db8-ae25-45b7-9cba-0f074df76208'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:25.851935 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:22:25.858844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1eb085b1-618e-4d10-935f-2804b13d4a9d tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-2301d0fc-8781-4316-bb8f-49201d5d4729-delete_snapshot" released by "delete_snapshot" :: held 0.855s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:26.291178 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-de0cfc9f-2775-4f54-9d0e-8c6ebea89236 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:26.421438 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:26.466775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (3c0371ec-ec0c-4db8-bbac-5c6fbb4703fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:26.473935 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf5fef8-0224-4112-bdb6-a55a80747fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:26.492677 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcf5fef8-0224-4112-bdb6-a55a80747fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1670834428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7cc6722d-a0c1-40a4-864b-ddc96e7b16b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89ddd692f04942778ad7ca8d9218ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=3f1a6f30-d053-49c4-adf4-dcf9256c1606,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:26Z,use_quota=True,user_id='2c735c8206584de58a0d85fa33ee2c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:26.498994 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb078fec-4e03-42ab-8227-40c1cb870649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:26.503824 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb078fec-4e03-42ab-8227-40c1cb870649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:26.510175 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feab8048-34b4-4d40-b642-5257eb49aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:26.531259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feab8048-34b4-4d40-b642-5257eb49aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7cc6722d-a0c1-40a4-864b-ddc96e7b16b6', 'volume_name': 'volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6', 'volume_size': 2, 'source_volid': '3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'source_volstatus': 'available'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:26.538621 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49dc11f-e641-40ca-8e64-5d30bde2a26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:26.556072 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b49dc11f-e641-40ca-8e64-5d30bde2a26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:26.564459 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82595344-2974-4085-8c7a-80372b2dbec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:26.566423 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Volume 7cc6722d-a0c1-40a4-864b-ddc96e7b16b6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6', 'volume_size': 2, 'source_volid': '3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'source_volstatus': 'available'}
Aug 27 21:22:26.581915 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:26.635523 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] creating snapshot='volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:22:26.718458 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] cloning 'volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606@volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6.clone_snap' to 'volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:22:26.780665 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-de0cfc9f-2775-4f54-9d0e-8c6ebea89236 tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:22:26.826885 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Volume volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:26.828667 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:26.829371 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:26.846036 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] resize volume 'volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6' from 1 to 2 {{(pid=133391) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}}
Aug 27 21:22:26.846976 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:27.030357 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] clone created successfully {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:22:27.034961 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82595344-2974-4085-8c7a-80372b2dbec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6', 'volume_size': 2, 'source_volid': '3f1a6f30-d053-49c4-adf4-dcf9256c1606', 'source_volstatus': 'available'}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:27.042843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d78530c-f261-48f7-889a-56cc51d31543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:27.058394 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Volume volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6 (7cc6722d-a0c1-40a4-864b-ddc96e7b16b6): created successfully
Aug 27 21:22:27.063528 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d78530c-f261-48f7-889a-56cc51d31543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:27.076605 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Flow 'volume_create_manager' (3c0371ec-ec0c-4db8-bbac-5c6fbb4703fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:27.100869 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-91c25642-d99d-480f-a169-960c0e6d1f8b tempest-VolumesCloneTest-625286051 None] Created volume successfully.
Aug 27 21:22:27.682017 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Acquiring lock "cinder-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:27.700758 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Lock "cinder-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:27.787554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:27.888508 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:27.902452 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] deleting rbd volume volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:28.228702 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:22:28.251894 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Volume volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:28.252386 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] deleting parent snapshot volume-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:22:28.844991 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Created reservations ['f336f0da-3f53-465f-a151-ea5f2c765cd3', '1d496175-5185-4c42-a4b8-a29e9e6e5f04', 'c934502c-29cf-41d1-8e90-fa3142fb9364', 'ab374328-4ee5-48ac-9aaa-0739ad67f602'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:28.913256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:28.961578 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:29.035780 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:29.047820 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Deleted volume successfully.
Aug 27 21:22:29.062749 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-92c7b0ba-e65c-4117-8b09-8b74bf0a5301 tempest-VolumesCloneTest-625286051 None] Lock "cinder-7cc6722d-a0c1-40a4-864b-ddc96e7b16b6-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:29.985887 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Acquiring lock "cinder-3f1a6f30-d053-49c4-adf4-dcf9256c1606-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:30.002415 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Lock "cinder-3f1a6f30-d053-49c4-adf4-dcf9256c1606-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:30.064454 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:30.144456 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:30.145709 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Volume volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:22:30.155307 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] deleting rbd volume volume-3f1a6f30-d053-49c4-adf4-dcf9256c1606 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:30.416234 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Created reservations ['8401f721-ae8e-47cc-95e4-1cf2380d5912', '17a8c52b-af1a-4dd8-97be-13cbb865e3f1', 'bbcefa71-259a-4519-9569-e503c3d415fa', '8f49cc34-a797-43ce-9b06-47d31c93bbde'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:30.430828 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=24,cinder:SELECT=61,cinder:DELETE=3,cinder:INSERT=12 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:30.470310 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:30.503013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:30.549907 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:30.556120 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Deleted volume successfully.
Aug 27 21:22:30.572679 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-a281add8-aedb-4b5c-8dd5-80ef71d873a8 tempest-VolumesCloneTest-625286051 None] Lock "cinder-3f1a6f30-d053-49c4-adf4-dcf9256c1606-delete_volume" released by "delete_volume" :: held 0.570s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:31.186261 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Acquiring lock "cinder-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:31.202804 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Lock "cinder-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:31.235883 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=53,cinder:UPDATE=31,cinder:INSERT=12,cinder:DELETE=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:22:31.267933 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:31.391786 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:31.403198 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] deleting rbd volume volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:31.633314 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:22:31.684062 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] deleting parent snapshot volume-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:22:32.705431 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Created reservations ['f172266c-94fb-48b2-bcaa-f7246e38c9af', '2b931b94-b9e5-4630-85e5-42abe8a30d62', 'c30582e0-6151-4771-bee3-c603bbbd0c1c', '3b32c420-c615-41fd-b683-d2ebcbc40ae1'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:32.767182 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:32.808784 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:32.862227 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:32.867398 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Deleted volume successfully.
Aug 27 21:22:32.887523 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-6c503dd0-ea7c-40ec-97c9-e441b4bec708 tempest-VolumesCloneTest-625286051 None] Lock "cinder-b66117ff-b0b8-41b8-9d35-54c1a54e6cf7-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:33.433149 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Acquiring lock "cinder-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:33.452083 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Lock "cinder-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:33.505420 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:33.605341 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:22:33.616244 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] deleting rbd volume volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:22:33.822068 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] volume is a clone so cleaning references {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:22:33.854144 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] deleting parent snapshot volume-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd.clone_snap {{(pid=133391) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:22:34.748652 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Created reservations ['f1dd573c-4c1a-424c-a425-3895b80b5287', 'bd385cbf-38e0-495a-93ff-4cf12db4a6d3', 'bcc7fc73-46b4-46a0-aa77-f14e1f12345f', 'c813f2ff-d8d9-413f-9d0e-fa6d79818914'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:22:34.829279 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:34.892391 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:34.950796 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:22:34.958219 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Deleted volume successfully.
Aug 27 21:22:34.977946 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-9cc28807-8801-49b3-8c0e-597b6b7a8497 tempest-VolumesCloneTest-625286051 None] Lock "cinder-d03b7fc4-0696-4f43-ac3b-1ab1a5048ddd-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:22:40.548242 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:22:40.569396 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Flow 'volume_create_manager' (ae6000e6-2c48-46a3-857b-1036fc25cd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:40.576406 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bc2e15-499d-4fc7-9675-86997794a9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.630553 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08bc2e15-499d-4fc7-9675-86997794a9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:22:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1877242857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c34f4e60-999d-47fa-a734-b71dee7643cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcf965d0edd34909ba62c56da03ffca5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:22:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:22:41Z,use_quota=True,user_id='33bb65ddf7914202851c585a346be4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.636440 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8218fdde-eac2-45af-838d-b4bfff8bb006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.640753 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8218fdde-eac2-45af-838d-b4bfff8bb006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.645774 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ca05f-3b12-4eb1-b9ad-7a8f2c43fe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.649804 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833ca05f-3b12-4eb1-b9ad-7a8f2c43fe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c34f4e60-999d-47fa-a734-b71dee7643cd', 'volume_name': 'volume-c34f4e60-999d-47fa-a734-b71dee7643cd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.654971 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f7765-1bc6-4dca-bf4e-b2fb45a0a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.658662 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c3f7765-1bc6-4dca-bf4e-b2fb45a0a528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.663272 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3575d5c-9338-4e9a-8e17-27a47ac042eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.664361 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Volume c34f4e60-999d-47fa-a734-b71dee7643cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c34f4e60-999d-47fa-a734-b71dee7643cd', 'volume_size': 1}
Aug 27 21:22:40.665844 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] creating volume 'volume-c34f4e60-999d-47fa-a734-b71dee7643cd' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:22:40.665974 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:40.732917 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:22:40.733290 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:22:40.737548 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3575d5c-9338-4e9a-8e17-27a47ac042eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c34f4e60-999d-47fa-a734-b71dee7643cd', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.742347 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f235ad6-d4a5-4904-a04c-c0b1148a223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:22:40.757220 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Volume volume-c34f4e60-999d-47fa-a734-b71dee7643cd (c34f4e60-999d-47fa-a734-b71dee7643cd): created successfully
Aug 27 21:22:40.761414 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f235ad6-d4a5-4904-a04c-c0b1148a223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:22:40.769026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Flow 'volume_create_manager' (ae6000e6-2c48-46a3-857b-1036fc25cd32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:22:40.776751 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d7c6edfc-a52a-4d3f-8e20-6e675e9faef4 tempest-VolumesNegativeTest-372573996 None] Created volume successfully.
Aug 27 21:22:44.975749 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-1616fac1-6155-4340-aabc-63a6e7c6d71f req-211fbb61-d9de-43a6-b363-a442b80fbef9 tempest-VolumesSnapshotTestJSON-104348141 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:22:45.921485 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_concurrency.processutils [req-1616fac1-6155-4340-aabc-63a6e7c6d71f req-211fbb61-d9de-43a6-b363-a442b80fbef9 tempest-VolumesSnapshotTestJSON-104348141 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.945s {{(pid=133391) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:22:45.923103 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [req-1616fac1-6155-4340-aabc-63a6e7c6d71f req-211fbb61-d9de-43a6-b363-a442b80fbef9 tempest-VolumesSnapshotTestJSON-104348141 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-78f14686-a6e3-4290-b213-3298d690e345', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': '78f14686-a6e3-4290-b213-3298d690e345', 'discard': True}} {{(pid=133391) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:22:45.954375 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-1616fac1-6155-4340-aabc-63a6e7c6d71f req-211fbb61-d9de-43a6-b363-a442b80fbef9 tempest-VolumesSnapshotTestJSON-104348141 None] Connection info returned from driver {'name': 'volumes/volume-78f14686-a6e3-4290-b213-3298d690e345', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '78f14686-a6e3-4290-b213-3298d690e345', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f22fc902-643c-4ba4-89c2-f7805a206260'} {{(pid=133391) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:22:46.008884 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-1616fac1-6155-4340-aabc-63a6e7c6d71f req-211fbb61-d9de-43a6-b363-a442b80fbef9 tempest-VolumesSnapshotTestJSON-104348141 None] attachment_update completed successfully.
Aug 27 21:22:48.102225 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f1268ce3-1a81-42bb-8570-5b8dc1064f1d tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:48.872579 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f1268ce3-1a81-42bb-8570-5b8dc1064f1d tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:22:49.589176 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3c1bdedc-51a2-4bb3-8a18-c82070afceab tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:22:50.830797 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3c1bdedc-51a2-4bb3-8a18-c82070afceab tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:22:51.707105 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-41ccf039-17f5-4de6-be40-e66978c582d7-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:22:51.720192 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-41ccf039-17f5-4de6-be40-e66978c582d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:22:51.722798 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:00.835709 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:UPDATE=25,cinder:SELECT=53,cinder:INSERT=6,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:01.414034 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=53,cinder:UPDATE=21,cinder:INSERT=2,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:02.884248 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:23:02.885761 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:02.920554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:02.964288 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:23:08.133750 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Acquiring lock "cinder-c34f4e60-999d-47fa-a734-b71dee7643cd-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:08.154235 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Lock "cinder-c34f4e60-999d-47fa-a734-b71dee7643cd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:08.225279 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:08.291408 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:23:08.292206 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Volume volume-c34f4e60-999d-47fa-a734-b71dee7643cd is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:23:08.299096 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] deleting rbd volume volume-c34f4e60-999d-47fa-a734-b71dee7643cd {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:23:08.505118 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Created reservations ['c86fea4f-1645-41ff-98c4-8806b44c903b', '3cdf4346-3777-4185-ac29-23b1aae746b5', 'b9db097c-a509-4ab3-a007-5e3d0fb72dd7', '6de0485f-4a85-4aca-85ed-2eae31383c77'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:08.552394 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:08.579232 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:08.610173 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:23:08.614546 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Deleted volume successfully.
Aug 27 21:23:08.627554 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-f8a01d77-736a-4a97-a54f-0f93b00eafeb tempest-VolumesNegativeTest-372573996 None] Lock "cinder-c34f4e60-999d-47fa-a734-b71dee7643cd-delete_volume" released by "delete_volume" :: held 0.474s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:12.075928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:23:12.102491 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Flow 'volume_create_manager' (bbcb41f7-e63c-4b1a-87db-fdb256d20f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:23:12.109413 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1338d59-2c21-4203-b89e-f59933421ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.128955 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1338d59-2c21-4203-b89e-f59933421ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-673470115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=10569646-3790-44b8-95a6-e5333adbc9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6e3180862c46948e80cf7b65d79117',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:23:12Z,use_quota=True,user_id='f419d93800984f39bbb2b16821f6e5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.136425 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c001e-8d60-4004-a26d-c4f0337164b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.142302 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c001e-8d60-4004-a26d-c4f0337164b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.148327 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832114f9-f9f4-48ad-9e99-c1f069729fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.153150 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (832114f9-f9f4-48ad-9e99-c1f069729fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10569646-3790-44b8-95a6-e5333adbc9cb', 'volume_name': 'volume-10569646-3790-44b8-95a6-e5333adbc9cb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.158300 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2621cc46-eddb-490c-b206-a50be509005f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.162203 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2621cc46-eddb-490c-b206-a50be509005f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.167132 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efb4631-823a-4c09-be83-801fa2371cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.168553 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Volume 10569646-3790-44b8-95a6-e5333adbc9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10569646-3790-44b8-95a6-e5333adbc9cb', 'volume_size': 1}
Aug 27 21:23:12.168948 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] creating volume 'volume-10569646-3790-44b8-95a6-e5333adbc9cb' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:23:12.169870 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:12.267222 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:23:12.267624 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:23:12.271283 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2efb4631-823a-4c09-be83-801fa2371cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10569646-3790-44b8-95a6-e5333adbc9cb', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.279664 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f849a71-778d-4381-a45a-cdea3cce58a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:23:12.294140 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Volume volume-10569646-3790-44b8-95a6-e5333adbc9cb (10569646-3790-44b8-95a6-e5333adbc9cb): created successfully
Aug 27 21:23:12.298600 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f849a71-778d-4381-a45a-cdea3cce58a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:23:12.308228 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Flow 'volume_create_manager' (bbcb41f7-e63c-4b1a-87db-fdb256d20f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:23:12.320135 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-8ee9f528-6552-4523-ba10-13b8b8d265b6 tempest-VolumesSnapshotListTestJSON-2070528308 None] Created volume successfully.
Aug 27 21:23:13.405818 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-3124428d-5da2-42d8-826a-7daaff45c8f4 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:13.914884 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-3124428d-5da2-42d8-826a-7daaff45c8f4 tempest-VolumesSnapshotListTestJSON-2070528308 None] Create snapshot completed successfully
Aug 27 21:23:14.807717 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-e52c31e9-6144-41ef-be53-ccfc32124802 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:15.947043 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-e52c31e9-6144-41ef-be53-ccfc32124802 tempest-VolumesSnapshotListTestJSON-2070528308 None] Create snapshot completed successfully
Aug 27 21:23:17.128874 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-bce3532a-1ff0-4f27-9c6f-2e2ce831fbf9 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:18.010517 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-bce3532a-1ff0-4f27-9c6f-2e2ce831fbf9 tempest-VolumesSnapshotListTestJSON-2070528308 None] Create snapshot completed successfully
Aug 27 21:23:19.180698 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] Acquiring lock "cinder-bbf559dc-6828-4a7e-80b9-6fc2db8eb4ab-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:19.201766 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-bbf559dc-6828-4a7e-80b9-6fc2db8eb4ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:19.203855 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:20.177351 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] Created reservations ['be80892f-3cb1-4740-9604-d55a4de3a499', '3ea3aad8-275b-4171-8959-71638ea3961a', '9d051196-887b-4340-a7f6-ced97eaf8d6b', '98202f86-89b6-4d0b-acf7-e93091384ef2'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:20.260721 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] Delete snapshot completed successfully.
Aug 27 21:23:20.285780 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5d69da1f-3098-4b7b-a5c6-a452f9967238 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-bbf559dc-6828-4a7e-80b9-6fc2db8eb4ab-delete_snapshot" released by "delete_snapshot" :: held 1.084s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:20.375050 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] Acquiring lock "cinder-4087b89e-c35a-4f00-a118-6c1a2d32e305-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:20.397417 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-4087b89e-c35a-4f00-a118-6c1a2d32e305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:20.400315 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:21.142122 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] Created reservations ['79354992-9e4b-4b69-9493-6cdaba65a6f4', '6dc1b4f5-a95f-43c0-9e92-03fb74d0a480', '77ed832c-3795-48d1-b1c7-78e84ed052fd', 'c9d4f562-16c2-49e3-a8b0-5c5c254b56bb'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:21.195529 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] Delete snapshot completed successfully.
Aug 27 21:23:21.202894 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0b13da61-2b00-47ab-b554-22c0c3066873 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-4087b89e-c35a-4f00-a118-6c1a2d32e305-delete_snapshot" released by "delete_snapshot" :: held 0.806s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:21.525407 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] Acquiring lock "cinder-467fe2ac-97f0-4b49-bb91-64e8d3f2074d-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:21.536987 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-467fe2ac-97f0-4b49-bb91-64e8d3f2074d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:21.538965 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:21.927239 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=60,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:21.971995 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['2a435c71-b387-4c2c-8a77-a98b99b70710', '03f2ea88-d2cc-4221-ac08-276e3dc6cb75', '3f0fcf70-2437-4b65-8982-aa5b76fb9bd8', '70f7866c-b261-4681-8799-02f63763bb1d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:22.041158 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:23:22.049393 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-0aba7068-7fc4-479b-b3ca-f91246e12f23 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-41ccf039-17f5-4de6-be40-e66978c582d7-delete_snapshot" released by "delete_snapshot" :: held 30.329s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:22.124561 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=63,cinder:UPDATE=24,cinder:INSERT=10,cinder:DELETE=3 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:22.155116 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] Created reservations ['009cef0f-bce8-44cd-9a95-8c349352b367', 'e5855723-3965-43e9-ba4d-8121df31b89f', '5c67de55-78b5-4999-8dc9-701cd49dca7a', '4f252046-c448-42e0-93a9-a1ce805d6d44'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:22.209372 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] Delete snapshot completed successfully.
Aug 27 21:23:22.216528 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-4c15e16d-ef2c-422e-9b5e-39ea9d0bc3ee tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-467fe2ac-97f0-4b49-bb91-64e8d3f2074d-delete_snapshot" released by "delete_snapshot" :: held 0.679s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:22.660587 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Acquiring lock "cinder-10569646-3790-44b8-95a6-e5333adbc9cb-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:22.672835 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-10569646-3790-44b8-95a6-e5333adbc9cb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:22.732772 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:22.786741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:23:22.788080 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Volume volume-10569646-3790-44b8-95a6-e5333adbc9cb is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:23:22.796929 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] deleting rbd volume volume-10569646-3790-44b8-95a6-e5333adbc9cb {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:23:23.106018 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Created reservations ['44fa448b-1790-4376-8a98-0a493b2dd6e9', '23f0f3db-8db1-4993-abd4-b3600f0d77fb', '365e9e59-754c-4b04-81d9-2b406c616ce2', '8446d885-323f-4f43-b598-f861acefd22e'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:23.160933 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-54a2e2a7-5c86-4b35-a643-817d4bec14d5-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:23.202328 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-54a2e2a7-5c86-4b35-a643-817d4bec14d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:23.202328 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:23.374096 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:23.437690 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:23:23.492656 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:23:23.499609 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Deleted volume successfully.
Aug 27 21:23:23.523682 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-1ffc2ff5-2c01-449c-8806-b3334a268fd2 tempest-VolumesSnapshotListTestJSON-2070528308 None] Lock "cinder-10569646-3790-44b8-95a6-e5333adbc9cb-delete_volume" released by "delete_volume" :: held 0.851s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:33.509808 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=25,cinder:UPDATE=20,cinder:INSERT=6,cinder:DELETE=1 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:53.434449 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=25,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:23:53.473401 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['7559f516-44cc-43f7-8d64-1b4bb3944bfa', '21be8b7e-7d72-4a88-8376-cbd796a025dc', '1436d7fb-52b9-4935-afac-734bd34f79a5', '1ce1cbf0-fd96-446c-85a6-b72a18b1a531'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:23:53.532704 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:23:53.539492 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d0d1e672-0440-4d45-b7aa-4bac854f2f4d tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-54a2e2a7-5c86-4b35-a643-817d4bec14d5-delete_snapshot" released by "delete_snapshot" :: held 30.343s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:23:53.880838 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-552b3474-9de7-43a7-a40e-cf2142669184-delete_snapshot" by "delete_snapshot" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:23:53.896842 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-552b3474-9de7-43a7-a40e-cf2142669184-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:23:53.898982 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:02.880909 ncdv-master-1 cinder-volume[133391]: DEBUG oslo_service.periodic_task [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=133391) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:24:02.881535 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:02.922741 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:03.017975 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-db48566d-be83-4a26-acf3-e2723f60aceb None None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:11.402055 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=2 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:24:12.150887 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:12.177803 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Flow 'volume_create_manager' (53c94ff9-75d5-42ee-92c9-d13c4452450f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:12.186368 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a5a36e-32a9-4fc8-9c9b-732ca88a1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.208843 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0a5a36e-32a9-4fc8-9c9b-732ca88a1936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-514025519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e1b39e3cb142c482feea428bfb676a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:12Z,use_quota=True,user_id='b831ae08e1aa4453b15419faf5baddd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e5adad0-01f5-4bd6-ad80-d41ff38ccfe6),volume_type_id=4e5adad0-01f5-4bd6-ad80-d41ff38ccfe6)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.218612 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb14615-eb57-41cf-9afe-a304cf2c1561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.224041 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cb14615-eb57-41cf-9afe-a304cf2c1561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.230241 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6aa549-ae90-48b4-bc52-df23d265b649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.235013 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f6aa549-ae90-48b4-bc52-df23d265b649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769', 'volume_name': 'volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.241737 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f83824-e814-41cb-97de-ff9593faf498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.249904 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28f83824-e814-41cb-97de-ff9593faf498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.258046 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c24774-493f-4c1f-abfc-a722598d5444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.260132 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Volume fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769', 'volume_size': 1}
Aug 27 21:24:12.260711 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] creating volume 'volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:24:12.262095 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:12.359957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] extra_specs: {} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:12.360646 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] extra_specs: {} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:12.365301 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c24774-493f-4c1f-abfc-a722598d5444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769', 'volume_size': 1}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.370316 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f9a0d-1b5d-4620-89cd-7e0e9eb10bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:12.383403 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Volume volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769 (fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769): created successfully
Aug 27 21:24:12.391366 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd6f9a0d-1b5d-4620-89cd-7e0e9eb10bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:12.401957 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Flow 'volume_create_manager' (53c94ff9-75d5-42ee-92c9-d13c4452450f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:12.415380 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-f4b60896-298c-4b61-94ab-ec00e1f6d118 tempest-VolumeTypesAccessTest-794182498 None] Created volume successfully.
Aug 27 21:24:13.611371 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Acquiring lock "cinder-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:13.640256 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Lock "cinder-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:13.658112 ncdv-master-1 cinder-volume[133391]: DEBUG dbcounter [-] [133391] Writing DB stats cinder:SELECT=26,cinder:UPDATE=16,cinder:INSERT=4 {{(pid=133391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:24:13.715775 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:13.833781 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:24:13.834988 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Volume volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:24:13.849095 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] deleting rbd volume volume-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:24:14.268220 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1191977901 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1191977901, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:24:14.269336 ncdv-master-1 cinder-volume[133391]: WARNING cinder.quota [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1191977901 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1191977901, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:24:14.289497 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Created reservations ['de6080bf-e79e-4508-bc7c-0ed5233d4696', 'e1b454aa-2593-4fbb-8e9c-87ada47673a3', '8916c46f-66cb-4b70-a78b-987862e6eb75', '8d72c594-ad82-43ae-a58b-e09db692c159'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:14.362490 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:14.421677 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:14.484151 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:14.489762 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Deleted volume successfully.
Aug 27 21:24:14.503213 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-5f547ac8-c0ee-4c95-a8b8-fa07601bdb4e tempest-VolumeTypesAccessTest-794182498 None] Lock "cinder-fbc089f4-5ac6-4210-b6a7-f8fa8a1a4769-delete_volume" released by "delete_volume" :: held 0.863s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:22.101673 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:22.143259 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Flow 'volume_create_manager' (8142c0cc-b4a4-466e-92fd-83a3e3e1e3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:22.151057 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c641831b-be4b-4a88-a1db-37eb942eeb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.173563 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c641831b-be4b-4a88-a1db-37eb942eeb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-245460054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a22d1f03-0b93-4e8b-a161-88866114e4f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24cfd5f37d114c50a2fa058b4e926693',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:22Z,use_quota=True,user_id='3496cf71b65e43ff8f8cb5c5ebc3907c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.182664 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b122c7-214d-436e-8413-eb89f4fdabcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.184338 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b122c7-214d-436e-8413-eb89f4fdabcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.190026 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95442bbb-6c39-4c2c-b1fe-e6712ed025a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.195817 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95442bbb-6c39-4c2c-b1fe-e6712ed025a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22d1f03-0b93-4e8b-a161-88866114e4f4', 'volume_name': 'volume-a22d1f03-0b93-4e8b-a161-88866114e4f4', 'volume_size': 2}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.202150 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c620385-6c3d-4bef-992e-a317aff25a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.208252 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c620385-6c3d-4bef-992e-a317aff25a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.215728 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f7817-ffd5-4d84-9dc9-7a54252b3846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.217951 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Volume a22d1f03-0b93-4e8b-a161-88866114e4f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22d1f03-0b93-4e8b-a161-88866114e4f4', 'volume_size': 2}
Aug 27 21:24:22.218976 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] creating volume 'volume-a22d1f03-0b93-4e8b-a161-88866114e4f4' {{(pid=133391) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:24:22.220144 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:22.373695 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:22.373695 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=133391) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:22.378301 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5f7817-ffd5-4d84-9dc9-7a54252b3846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22d1f03-0b93-4e8b-a161-88866114e4f4', 'volume_size': 2}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.385573 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdeff5db-c2ad-45db-8c31-cb497665fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:22.405181 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Volume volume-a22d1f03-0b93-4e8b-a161-88866114e4f4 (a22d1f03-0b93-4e8b-a161-88866114e4f4): created successfully
Aug 27 21:24:22.414177 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdeff5db-c2ad-45db-8c31-cb497665fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:22.424989 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Flow 'volume_create_manager' (8142c0cc-b4a4-466e-92fd-83a3e3e1e3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:22.444696 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-ff3036e5-5462-4635-8aa2-2aa9b98e7654 tempest-VolumesCloneNegativeTest-2119724276 None] Created volume successfully.
Aug 27 21:24:23.275587 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Acquiring lock "cinder-a22d1f03-0b93-4e8b-a161-88866114e4f4-delete_volume" by "delete_volume" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:23.299174 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Lock "cinder-a22d1f03-0b93-4e8b-a161-88866114e4f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:23.346114 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:23.435547 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] volume has no backup snaps {{(pid=133391) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:24:23.436098 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Volume volume-a22d1f03-0b93-4e8b-a161-88866114e4f4 is not a clone. {{(pid=133391) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:24:23.448549 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] deleting rbd volume volume-a22d1f03-0b93-4e8b-a161-88866114e4f4 {{(pid=133391) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:24:23.762360 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Created reservations ['7037f31d-0bf8-45d6-889a-6b85ca291eab', '32d77af3-a7a7-4173-86ad-c8417ceeeaa6', '7803b28d-8e7c-4324-9f98-3b052fa08ebf', '0e6a2296-4b7d-43e7-bf05-de1211c97748'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:23.882798 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:23.937062 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:24.010010 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.manager [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Notifying Schedulers of capabilities ... {{(pid=133391) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:24.016522 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Deleted volume successfully.
Aug 27 21:24:24.041725 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-117ace57-c64a-4e7e-8510-6cc9aba49d23 tempest-VolumesCloneNegativeTest-2119724276 None] Lock "cinder-a22d1f03-0b93-4e8b-a161-88866114e4f4-delete_volume" released by "delete_volume" :: held 0.743s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:24.180913 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.quota [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['e9c04b2e-137d-4a00-ac74-a1e94707fe92', '924e7ccb-a5eb-47ec-b196-c997958d8d88', 'f7dfa515-c7e8-44a0-89da-66b4f62a1369', '0b81fed9-fd14-4c4c-962b-2fc518574b4d'] {{(pid=133391) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:24.234152 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:24:24.241096 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-d350ce93-f94e-4049-98c7-3eebff05ba6b tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-552b3474-9de7-43a7-a40e-cf2142669184-delete_snapshot" released by "delete_snapshot" :: held 30.344s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:26.159744 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.manager [req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 req-4abb87c6-5cab-4f46-8a54-2713a7c4d064 tempest-VolumesSnapshotTestJSON-104348141 None] Terminate volume connection completed successfully.
Aug 27 21:24:26.160358 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [req-af513bc1-7e2d-41c8-92bc-ccf2930ecc17 req-4abb87c6-5cab-4f46-8a54-2713a7c4d064 tempest-VolumesSnapshotTestJSON-104348141 None] Deleting attachment f22fc902-643c-4ba4-89c2-f7805a206260. {{(pid=133391) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:24:29.813475 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=133391) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:29.861848 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Flow 'volume_create_manager' (398a6e82-c49a-4764-8c04-86f281c7e098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:29.870064 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea49c9-9821-4513-8cf4-e5652e5b0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:29.891465 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cea49c9-9821-4513-8cf4-e5652e5b0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1726146263',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e666d13e-c4d3-477e-ad1a-b516e35a9978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205b511695494b88971d5383f8594291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:30Z,use_quota=True,user_id='4a62d1c41f2b447c8c5dc3d0e8ff4ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:29.900809 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26d7f2f-3611-451c-8308-eaf584a5243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:29.906825 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a26d7f2f-3611-451c-8308-eaf584a5243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:29.913693 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be7499-50c6-481e-9d94-162f74e6078f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:30.046416 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38be7499-50c6-481e-9d94-162f74e6078f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e666d13e-c4d3-477e-ad1a-b516e35a9978', 'volume_name': 'volume-e666d13e-c4d3-477e-ad1a-b516e35a9978', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51acabd730>}' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:30.060529 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff56c5c-98fc-434f-aec0-d43acef42e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:30.067244 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff56c5c-98fc-434f-aec0-d43acef42e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:30.074093 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.manager [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dd9288-bb39-431f-8c27-f9ff5bf24f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=133391) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:30.077121 ncdv-master-1 cinder-volume[133391]: INFO cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Volume e666d13e-c4d3-477e-ad1a-b516e35a9978: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e666d13e-c4d3-477e-ad1a-b516e35a9978', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51acabd730>}
Aug 27 21:24:30.078006 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Cloning e666d13e-c4d3-477e-ad1a-b516e35a9978 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=133391) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:24:30.087166 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:30.106338 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:30.128494 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 24, 30, 113118)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:24:30.129887 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:24:30.130742 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:24:30.139823 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.coordination [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.035s {{(pid=133391) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:30.142143 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:24:30.151000 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 24, 30, 148423)}. {{(pid=133391) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:24:30.151928 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.image.cache [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=133391) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:24:30.152588 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.flows.manager.create_volume [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=133391) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:24:30.170221 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=133391) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:30.271071 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] creating snapshot='volume-e666d13e-c4d3-477e-ad1a-b516e35a9978.clone_snap' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:24:30.893428 ncdv-master-1 cinder-volume[133391]: DEBUG cinder.volume.drivers.rbd [None req-220edf44-5cb2-4356-959b-3694d10c86f6 tempest-VolumesExtendTest-942551900 None] cloning 'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee@volume-e666d13e-c4d3-477e-ad1a-b516e35a9978.clone_snap' to 'volume-e666d13e-c4d3-477e-ad1a-b516e35a9978' {{(pid=133391) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:24:31.200929 ncdv-master-1 cinder-volume[133391]: terminate called after throwing an instance of 'std::out_of_range'
Aug 27 21:24:31.201271 ncdv-master-1 cinder-volume[133391]:   what():  map::at
Aug 27 21:24:31.227218 ncdv-master-1 cinder-volume[133218]: INFO oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Child 133391 killed by signal 6
Aug 27 21:24:31.234128 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Started child 185274 {{(pid=133218) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Aug 27 21:24:31.248929 ncdv-master-1 cinder-volume[185274]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Aug 27 21:24:31.470732 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Starting volume driver RBDDriver (1.2.0)
Aug 27 21:24:31.473440 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:31.592044 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:31.683404 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:31.751984 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.driver [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Driver hasn't implemented _init_vendor_properties()
Aug 27 21:24:31.752433 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.driver [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.79, 'free_capacity_gb': 19.34, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f60509cb-0788-4b7d-926f-6a9af5c8f250:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=185274) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Aug 27 21:24:31.778438 ncdv-master-1 cinder-volume[185274]: DEBUG oslo_db.sqlalchemy.engines [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=185274) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 21:24:31.785451 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writer thread running {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 27 21:24:31.911528 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.db.sqlalchemy.api [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Building query based on filter {{(pid=185274) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Aug 27 21:24:31.964966 ncdv-master-1 cinder-volume[185274]: INFO cinder.keymgr.migration [None req-26d6feca-3f44-4caa-a1c0-0aed3abc8768 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 27 21:24:31.971051 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:32.057388 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:32.101188 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:32.160044 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Driver initialization completed successfully.
Aug 27 21:24:32.161260 ncdv-master-1 cinder-volume[185274]: INFO cinder.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Initiating service 3 cleanup
Aug 27 21:24:32.335959 ncdv-master-1 cinder-volume[185274]: INFO cinder.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Cleaning Volume with id e666d13e-c4d3-477e-ad1a-b516e35a9978 and status creating
Aug 27 21:24:32.362338 ncdv-master-1 cinder-volume[185274]: INFO cinder.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Service 3 cleanup completed.
Aug 27 21:24:32.362818 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.service [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Creating RPC server for service cinder-volume {{(pid=185274) start /opt/stack/cinder/cinder/service.py:238}}
Aug 27 21:24:32.372299 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.service [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=185274) start /opt/stack/cinder/cinder/service.py:244}}
Aug 27 21:24:32.418839 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Aug 27 21:24:32.420145 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:32.491212 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:32.620680 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-860f8039-56f0-4898-aea1-9672a641e2cd None None] Driver post RPC initialization completed successfully.
Aug 27 21:24:32.668992 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:32.861762 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (1adf29d0-378d-4cae-9ff0-c9f7e64a3387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:32.869688 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bc2d85-768c-45bd-bfc2-38e03059ea96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:32.924888 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bc2d85-768c-45bd-bfc2-38e03059ea96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-208350377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=086fb04e-c746-4265-a926-03fe56fd3410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:32Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:32.931260 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695ab7f4-969e-4308-b63e-dd77568410f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:32.935292 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695ab7f4-969e-4308-b63e-dd77568410f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:32.940772 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb959b99-6169-4c92-9f52-d433cd3a477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:32.944894 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb959b99-6169-4c92-9f52-d433cd3a477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '086fb04e-c746-4265-a926-03fe56fd3410', 'volume_name': 'volume-086fb04e-c746-4265-a926-03fe56fd3410', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:32.950970 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e886b9e-6c45-4151-ad0e-d1a5ab389313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:32.967306 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e886b9e-6c45-4151-ad0e-d1a5ab389313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:32.967306 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29551d8-981d-466b-a9b6-118bf01ac73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:32.967306 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Volume 086fb04e-c746-4265-a926-03fe56fd3410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-086fb04e-c746-4265-a926-03fe56fd3410', 'volume_size': 1}
Aug 27 21:24:32.967306 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] creating volume 'volume-086fb04e-c746-4265-a926-03fe56fd3410' {{(pid=185274) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:24:32.967743 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:33.219079 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:33.219654 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:33.224261 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f29551d8-981d-466b-a9b6-118bf01ac73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-086fb04e-c746-4265-a926-03fe56fd3410', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.233047 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291e0174-1acd-4673-84a9-4597edda64d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.264838 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-086fb04e-c746-4265-a926-03fe56fd3410 (086fb04e-c746-4265-a926-03fe56fd3410): created successfully
Aug 27 21:24:33.277207 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291e0174-1acd-4673-84a9-4597edda64d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.327538 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (1adf29d0-378d-4cae-9ff0-c9f7e64a3387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:33.356929 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-b2b2b483-53b8-48b1-b7da-34563929c1e4 tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:24:33.591207 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:33.630055 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Flow 'volume_create_manager' (f0478bd5-d271-4657-a6c5-42a28086cffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:33.653765 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9c42d1-1ab8-4bdf-804d-b49bd347e13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.706759 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9c42d1-1ab8-4bdf-804d-b49bd347e13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1212504331',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=011040b3-dc45-4294-8b85-2a401bfeff31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='205b511695494b88971d5383f8594291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:34Z,use_quota=True,user_id='4a62d1c41f2b447c8c5dc3d0e8ff4ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.716061 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd68c6d-dd8d-4d9c-872c-83b151be3bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.720823 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd68c6d-dd8d-4d9c-872c-83b151be3bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.728638 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a50969-558e-4564-92a9-76fb7d26d877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.736471 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75a50969-558e-4564-92a9-76fb7d26d877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '011040b3-dc45-4294-8b85-2a401bfeff31', 'volume_name': 'volume-011040b3-dc45-4294-8b85-2a401bfeff31', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.753625 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350c90a-9929-47c6-b10b-b0c81feb0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.775130 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9350c90a-9929-47c6-b10b-b0c81feb0dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:33.787171 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4328c036-d892-4b83-9882-29e7fcba4f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:33.788414 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Volume 011040b3-dc45-4294-8b85-2a401bfeff31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-011040b3-dc45-4294-8b85-2a401bfeff31', 'volume_size': 1}
Aug 27 21:24:33.788812 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] creating volume 'volume-011040b3-dc45-4294-8b85-2a401bfeff31' {{(pid=185274) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:24:33.789475 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:33.994036 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:33.994675 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:34.002096 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4328c036-d892-4b83-9882-29e7fcba4f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-011040b3-dc45-4294-8b85-2a401bfeff31', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:34.022718 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8078350b-e937-4969-94b0-6d72d5a8b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:34.055015 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Volume volume-011040b3-dc45-4294-8b85-2a401bfeff31 (011040b3-dc45-4294-8b85-2a401bfeff31): created successfully
Aug 27 21:24:34.065641 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8078350b-e937-4969-94b0-6d72d5a8b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:34.097056 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Flow 'volume_create_manager' (f0478bd5-d271-4657-a6c5-42a28086cffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:34.169739 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-444386b5-ce11-4780-8b9d-9c5f35160ab4 tempest-VolumesExtendTest-942551900 None] Created volume successfully.
Aug 27 21:24:34.501697 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8f7c6fa-4439-4cbc-a6e8-52fe36d1e14e tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:35.133401 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-d8f7c6fa-4439-4cbc-a6e8-52fe36d1e14e tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:24:35.259096 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-43ea92d6-f08f-465d-b973-e9a5808faf4f tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:36.204219 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-43ea92d6-f08f-465d-b973-e9a5808faf4f tempest-VolumesExtendTest-942551900 None] Create snapshot completed successfully
Aug 27 21:24:36.550039 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:36.631949 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (77691bfa-8ae0-4b63-b1ae-a04a234399c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:36.639374 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467350a-f2b8-4c48-b9bd-c7628b8edd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:36.657870 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d467350a-f2b8-4c48-b9bd-c7628b8edd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1049434308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=0bb9c87b-b1c5-4055-984d-1da42bb31b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b35d7708-7a33-4abe-9eef-b0b075fd5f1d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:36Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:36.663198 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a39ef4-8b10-4bfb-a7ba-64fba8f3d5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:36.667750 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a39ef4-8b10-4bfb-a7ba-64fba8f3d5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:36.672802 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba5f955-5610-4806-b903-cf4ac39e212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:36.676986 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bba5f955-5610-4806-b903-cf4ac39e212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0bb9c87b-b1c5-4055-984d-1da42bb31b16', 'volume_name': 'volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16', 'volume_size': 2, 'snapshot_id': 'b35d7708-7a33-4abe-9eef-b0b075fd5f1d'}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:36.683764 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cb17d3-f34e-4a4c-9aa4-3032b4680225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:36.687691 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cb17d3-f34e-4a4c-9aa4-3032b4680225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:36.692406 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e2c826-0556-40f1-bc12-2d7d1f53cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:36.693553 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Volume 0bb9c87b-b1c5-4055-984d-1da42bb31b16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16', 'volume_size': 2, 'snapshot_id': 'b35d7708-7a33-4abe-9eef-b0b075fd5f1d'}
Aug 27 21:24:36.744699 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-07098c1f-4679-45f8-a8cb-ac69978542b8 tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:36.861059 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] cloning volumes/volume-086fb04e-c746-4265-a926-03fe56fd3410@snapshot-b35d7708-7a33-4abe-9eef-b0b075fd5f1d to volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16 {{(pid=185274) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Aug 27 21:24:36.861745 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:36.976380 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:37.079324 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-07098c1f-4679-45f8-a8cb-ac69978542b8 tempest-VolumesExtendTest-942551900 None] Extend volume from 1 GB to 2 GB. {{(pid=185274) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Aug 27 21:24:37.159932 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-07098c1f-4679-45f8-a8cb-ac69978542b8 tempest-VolumesExtendTest-942551900 None] Extend volume completed successfully.
Aug 27 21:24:37.175013 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:37.175600 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:37.184312 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:37.387426 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:37.464546 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.drivers.rbd [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues
Aug 27 21:24:37.503005 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e2c826-0556-40f1-bc12-2d7d1f53cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16', 'volume_size': 2, 'snapshot_id': 'b35d7708-7a33-4abe-9eef-b0b075fd5f1d'}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:37.517011 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5326b-582a-47ff-aa65-7aecb2910ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:37.533925 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16 (0bb9c87b-b1c5-4055-984d-1da42bb31b16): created successfully
Aug 27 21:24:37.540926 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f5326b-582a-47ff-aa65-7aecb2910ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:37.558422 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (77691bfa-8ae0-4b63-b1ae-a04a234399c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:37.598635 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-79085f7c-7f1c-4f32-8e83-50d9b5255560 tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:24:38.067080 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Acquiring lock "cinder-e717ec7d-c722-4b04-b9a7-642cee45502c-delete_snapshot" by "delete_snapshot" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:38.093530 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Lock "cinder-e717ec7d-c722-4b04-b9a7-642cee45502c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:38.095016 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:38.652905 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-0bb9c87b-b1c5-4055-984d-1da42bb31b16-delete_volume" by "delete_volume" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:38.679791 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-0bb9c87b-b1c5-4055-984d-1da42bb31b16-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:38.743539 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:38.847739 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:24:38.855541 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] deleting rbd volume volume-0bb9c87b-b1c5-4055-984d-1da42bb31b16 {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:24:39.240937 ncdv-master-1 cinder-volume[185274]: WARNING cinder.quota [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:24:39.241972 ncdv-master-1 cinder-volume[185274]: WARNING cinder.quota [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:24:39.249989 ncdv-master-1 cinder-volume[185274]: WARNING cinder.quota [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:24:39.285382 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['21a22de2-d6ea-4266-83c8-d5b4b9198684', 'f03fced3-b48f-4e3f-9904-2a7b2eeefca0', '9796f5db-6229-41a6-9749-76e64844d952', '002a6544-8bc9-4b88-b09e-5e00a3255318'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:39.296911 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Created reservations ['185599f0-fe7a-47aa-b270-6cf325f5469a', 'bd8644a0-62a1-4b32-b9bc-886954e655d5', '2060c61c-2ad0-410f-b43a-ff006f2b9ff8', '4009ac44-60d4-4760-a4d4-f6aacfe5e403'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:39.422667 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Delete snapshot completed successfully.
Aug 27 21:24:39.434777 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-c0682a79-9a66-426c-b675-7b4ea36ab0be tempest-VolumesExtendTest-942551900 None] Lock "cinder-e717ec7d-c722-4b04-b9a7-642cee45502c-delete_snapshot" released by "delete_snapshot" :: held 1.341s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:39.455418 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:39.528330 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:39.606082 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:39.611186 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Deleted volume successfully.
Aug 27 21:24:39.629310 ncdv-master-1 cinder-volume[185274]: DEBUG oslo_service.periodic_task [None req-d829d17e-6f23-44bf-af75-f83628bf1752 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=185274) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:24:39.630099 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d829d17e-6f23-44bf-af75-f83628bf1752 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:39.690281 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d829d17e-6f23-44bf-af75-f83628bf1752 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:39.782586 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-d829d17e-6f23-44bf-af75-f83628bf1752 None None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:39.788088 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3ec3a393-d0bb-4a11-b78a-52d2a466f4c0 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-0bb9c87b-b1c5-4055-984d-1da42bb31b16-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:40.427978 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Acquiring lock "cinder-011040b3-dc45-4294-8b85-2a401bfeff31-delete_volume" by "delete_volume" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:40.452570 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Lock "cinder-011040b3-dc45-4294-8b85-2a401bfeff31-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:40.535823 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:40.660930 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:24:40.661482 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Volume volume-011040b3-dc45-4294-8b85-2a401bfeff31 is not a clone. {{(pid=185274) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:24:40.669774 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] deleting rbd volume volume-011040b3-dc45-4294-8b85-2a401bfeff31 {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:24:40.744590 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:24:40.788658 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (2b8e0713-d2c5-47e5-8f80-085900f20f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:40.800327 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01cb3c-2d9b-4727-90e8-21c644be13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:40.843907 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf01cb3c-2d9b-4727-90e8-21c644be13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-957841701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4c00caa8-f392-4f61-b6b8-768fe14aa20a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:41Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:40.852798 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f4f65f-43ea-4ffa-ab26-1a0691ac5aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:40.861574 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f4f65f-43ea-4ffa-ab26-1a0691ac5aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:40.867903 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c090a69a-e38e-45f2-9794-6826951cdec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:40.873587 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c090a69a-e38e-45f2-9794-6826951cdec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c00caa8-f392-4f61-b6b8-768fe14aa20a', 'volume_name': 'volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:40.879966 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1570f0-b4d2-4d86-bd1d-63c58ad28876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:40.885540 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1570f0-b4d2-4d86-bd1d-63c58ad28876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:40.893138 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeee477-8d3b-480b-9b08-44dad37151fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:40.894338 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Volume 4c00caa8-f392-4f61-b6b8-768fe14aa20a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a', 'volume_size': 1}
Aug 27 21:24:40.894736 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] creating volume 'volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a' {{(pid=185274) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:24:40.895875 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:41.080532 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:24:41.081263 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:24:41.086386 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddeee477-8d3b-480b-9b08-44dad37151fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:41.096473 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f65943-ac35-4c6f-9c8e-91a8775cb144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:24:41.120071 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a (4c00caa8-f392-4f61-b6b8-768fe14aa20a): created successfully
Aug 27 21:24:41.124126 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49f65943-ac35-4c6f-9c8e-91a8775cb144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:24:41.146198 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (2b8e0713-d2c5-47e5-8f80-085900f20f2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:24:41.183025 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-06e9b002-a370-4908-906b-986d4363df18 tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:24:41.195624 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=67,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=2 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:24:41.218436 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=66,cinder:UPDATE=23,cinder:DELETE=5,cinder:INSERT=6 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:24:41.276558 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Created reservations ['2d6c7b32-0e4a-4565-b266-340de3f81284', '4a3c1033-be3f-4e94-a398-0c4153960d12', 'b05d4267-c9a7-49a3-bdc5-124d1b09a327', 'a0c3fd4c-d697-4194-a539-51f42797c955'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:24:41.379692 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:41.481408 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:41.642012 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:24:41.651130 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Deleted volume successfully.
Aug 27 21:24:41.676025 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-3fdac858-86be-43cf-bc97-fbad4167d3bc tempest-VolumesExtendTest-942551900 None] Lock "cinder-011040b3-dc45-4294-8b85-2a401bfeff31-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:24:41.832281 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] Acquiring lock "cinder-e666d13e-c4d3-477e-ad1a-b516e35a9978-delete_volume" by "delete_volume" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:24:41.878346 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] Lock "cinder-e666d13e-c4d3-477e-ad1a-b516e35a9978-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:24:42.026806 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-6f677f7d-9423-4af3-a25f-ca302c9a49ca tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:42.201538 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:24:42.330917 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:24:42.349427 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] deleting rbd volume volume-e666d13e-c4d3-477e-ad1a-b516e35a9978 {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:24:42.709864 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] volume is a clone so cleaning references {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:24:42.749055 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] deleting parent snapshot volume-e666d13e-c4d3-477e-ad1a-b516e35a9978.clone_snap {{(pid=185274) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:25:00.323458 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:00.324149 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:00.396830 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-e3d2c923-1ba7-4296-a6d9-bfded5178ef0 tempest-GroupsV314Test-657961322 None] Group tempest-GroupsV314Test-Group-875284985: creating
Aug 27 21:25:00.413030 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] Lock "cinder-e666d13e-c4d3-477e-ad1a-b516e35a9978-delete_volume" released by "delete_volume" :: held 18.537s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server [None req-bc7f08aa-ee1a-4217-9c3f-a6bab5e773d9 tempest-VolumesExtendTest-942551900 None] Exception during message handling: rbd.ReadOnlyImage: [errno 30] RBD read-only image (error removing snapshot b'volume-e666d13e-c4d3-477e-ad1a-b516e35a9978.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, volume, *args, **kwargs)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:25:00.476593 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1042, in delete_volume
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     self._clear_db(volume, new_status)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     self.driver.delete_volume(volume)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 1348, in delete_volume
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     self._delete_clone_parent_refs(client, parent, parent_snap)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 1241, in _delete_clone_parent_refs
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     parent_rbd.remove_snap(parent_snap)
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3551, in rbd.Image.remove_snap
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error removing snapshot b'volume-e666d13e-c4d3-477e-ad1a-b516e35a9978.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:00.477973 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:00.503324 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:00.524070 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (437f31a6-6f3e-4b69-986b-7a1163c8c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:00.530299 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8b122-a3ad-4cbc-9555-a6cd87abc63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.539051 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-6f677f7d-9423-4af3-a25f-ca302c9a49ca tempest-VolumesSnapshotTestJSON-104348141 None] Create snapshot completed successfully
Aug 27 21:25:00.560480 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8b122-a3ad-4cbc-9555-a6cd87abc63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:00.565706 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080d516-31af-4bc1-b666-7a90306699ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.569751 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080d516-31af-4bc1-b666-7a90306699ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:00.577310 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a07b4-72fb-48f6-b9c8-c63e3c40c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.598610 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-e3d2c923-1ba7-4296-a6d9-bfded5178ef0 tempest-GroupsV314Test-657961322 None] Group tempest-GroupsV314Test-Group-875284985: created successfully
Aug 27 21:25:00.608732 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-e3d2c923-1ba7-4296-a6d9-bfded5178ef0 tempest-GroupsV314Test-657961322 None] Create group completed successfully.
Aug 27 21:25:00.679784 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a07b4-72fb-48f6-b9c8-c63e3c40c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aae95fa0>}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:00.684802 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4424b1c-f5eb-4541-ad1f-2db0e57f27ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.688679 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4424b1c-f5eb-4541-ad1f-2db0e57f27ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:00.693245 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67355854-efe0-446f-973c-4cc6ecb20ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.694340 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aae95fa0>}
Aug 27 21:25:00.694941 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Cloning 666307a6-8467-4390-93c8-75c3338064e9 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=185274) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:25:00.695958 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:00.704583 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:00.720316 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 0, 712346)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:00.720858 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:00.721268 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:25:00.725564 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:00.726694 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:25:00.732964 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 0, 730680)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:00.733385 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:00.733787 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:25:00.746984 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:00.803446 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] creating snapshot='volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:25:00.863265 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67355854-efe0-446f-973c-4cc6ecb20ba9) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 27 21:25:00.863265 ncdv-master-1 cinder-volume[185274]: 5 predecessors (most recent first):
Aug 27 21:25:00.863265 ncdv-master-1 cinder-volume[185274]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac98fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': None}
Aug 27 21:25:00.863658 ncdv-master-1 cinder-volume[185274]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac98fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51aae95fa0>}}
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'retry': {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']}, 'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'snapshot_id': None, 'source_volid': None, 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume': {'id': '666307a6-8467-4390-93c8-75c3338064e9', '_name_id': None, 'ec2_id': None, 'user_id': 'f89258f563db4e10a40153d2726c476a', 'project_id': '66298860789b4efa821b1168a8d982ec', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-27T21:24:43.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'name_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'metadata': {}, 'qos_specs': None}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'context': <cinder.context.RequestContext object at 0x7f51ac98fbb0>}, 'provides': None}
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac98fbb0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:24:44Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return fut.result()
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return self.__get_result()
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     raise self._exception
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:00.863798 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:00.877374 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67355854-efe0-446f-973c-4cc6ecb20ba9) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.882247 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67355854-efe0-446f-973c-4cc6ecb20ba9) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:00.887680 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4424b1c-f5eb-4541-ad1f-2db0e57f27ae) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.891534 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4424b1c-f5eb-4541-ad1f-2db0e57f27ae) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:00.896320 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a07b4-72fb-48f6-b9c8-c63e3c40c339) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.900495 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e9a07b4-72fb-48f6-b9c8-c63e3c40c339) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:00.905080 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080d516-31af-4bc1-b666-7a90306699ca) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:00.906403 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Updating volume 666307a6-8467-4390-93c8-75c3338064e9 with {'scheduled_at': datetime.datetime(2022, 8, 27, 21, 25, 0, 906014), 'host': None}. {{(pid=185274) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 27 21:25:00.917838 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduling SchedulerAPI.create_volume attempt 1 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap') {{(pid=185274) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 27 21:25:00.944127 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduled {{(pid=185274) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 27 21:25:00.944769 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:00.984299 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] volume volume-666307a6-8467-4390-93c8-75c3338064e9 no longer exists in backend
Aug 27 21:25:01.002709 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080d516-31af-4bc1-b666-7a90306699ca) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 27 21:25:01.008009 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8b122-a3ad-4cbc-9555-a6cd87abc63b) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.013617 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c8b122-a3ad-4cbc-9555-a6cd87abc63b) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:01.021280 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (437f31a6-6f3e-4b69-986b-7a1163c8c4f9) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.042462 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.074566 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume reschedule parameters: True retry: {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:01.096356 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (88f9695b-40aa-41b1-8ce1-6ceee2e29b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:01.103011 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f63f0a4-360d-472e-b6f6-d3bf4c49616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.119613 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f63f0a4-360d-472e-b6f6-d3bf4c49616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.124823 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6cfca0-2c55-4cac-a260-343c46cf40e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.128872 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6cfca0-2c55-4cac-a260-343c46cf40e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.133981 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c202a-b043-4cb1-82bb-680fb60a910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.233858 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c202a-b043-4cb1-82bb-680fb60a910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac715550>}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.239241 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b851846-2504-48cd-bb99-4130621eecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.244408 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b851846-2504-48cd-bb99-4130621eecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.250590 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c78cc-e292-407f-8698-673970615e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.252517 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac715550>}
Aug 27 21:25:01.253593 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Cloning 666307a6-8467-4390-93c8-75c3338064e9 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=185274) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:25:01.254360 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:01.269215 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:01.279120 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 1, 274880)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:01.279917 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:01.280746 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:25:01.285939 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.017s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:01.286588 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:25:01.294170 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 1, 291504)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:01.294667 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:01.295128 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:25:01.312575 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:01.424084 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] creating snapshot='volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c78cc-e292-407f-8698-673970615e6c) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]: 5 predecessors (most recent first):
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7ea1c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': None}
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7ea1c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac715550>}}
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'snapshot_id': None, 'source_volid': None, 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume': {'id': '666307a6-8467-4390-93c8-75c3338064e9', '_name_id': None, 'ec2_id': None, 'user_id': 'f89258f563db4e10a40153d2726c476a', 'project_id': '66298860789b4efa821b1168a8d982ec', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-27T21:24:43.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'name_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'context': <cinder.context.RequestContext object at 0x7f51ac7ea1c0>}, 'provides': None}
Aug 27 21:25:01.454259 ncdv-master-1 cinder-volume[185274]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7ea1c0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:01Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return fut.result()
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return self.__get_result()
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     raise self._exception
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.454884 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:01.476649 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c78cc-e292-407f-8698-673970615e6c) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.487374 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857c78cc-e292-407f-8698-673970615e6c) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:01.498131 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b851846-2504-48cd-bb99-4130621eecaa) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.512104 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b851846-2504-48cd-bb99-4130621eecaa) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:01.516915 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c202a-b043-4cb1-82bb-680fb60a910d) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.533620 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa8c202a-b043-4cb1-82bb-680fb60a910d) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:01.543289 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6cfca0-2c55-4cac-a260-343c46cf40e3) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.547332 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Updating volume 666307a6-8467-4390-93c8-75c3338064e9 with {'scheduled_at': datetime.datetime(2022, 8, 27, 21, 25, 1, 546772), 'host': None}. {{(pid=185274) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 27 21:25:01.565919 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduling SchedulerAPI.create_volume attempt 2 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap') {{(pid=185274) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 27 21:25:01.599903 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduled {{(pid=185274) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 27 21:25:01.600974 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:01.687293 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] volume volume-666307a6-8467-4390-93c8-75c3338064e9 no longer exists in backend
Aug 27 21:25:01.695562 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6cfca0-2c55-4cac-a260-343c46cf40e3) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 27 21:25:01.701873 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f63f0a4-360d-472e-b6f6-d3bf4c49616b) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.714008 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f63f0a4-360d-472e-b6f6-d3bf4c49616b) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:01.732460 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (88f9695b-40aa-41b1-8ce1-6ceee2e29b08) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:01.734782 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:01.775055 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:01.788708 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume reschedule parameters: True retry: {'num_attempts': 3, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:01.809608 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (05b6f904-8412-4fe2-ad0e-d229bc1445e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:01.816854 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1b5d-2af6-496e-86f9-4ee1fa08d8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.847324 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1b5d-2af6-496e-86f9-4ee1fa08d8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.852989 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ee4c-f366-4e90-9003-d7c95d048660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.867697 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ee4c-f366-4e90-9003-d7c95d048660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.873078 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c38d54-8d3a-4a94-a866-812c6db74cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.892742 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (706f319b-1567-43cc-8de1-1a3d309751b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:01.900587 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526a45c-1cb1-4a72-b3e7-272369f974e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.920777 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1526a45c-1cb1-4a72-b3e7-272369f974e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-285577762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=67212e0f-ffde-4831-aa2d-42ac20d52b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4b1b49ecb334270a40234aa2e1a16ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3ff24033-a83e-4600-8682-c2520dc3db73,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='9f8c78c1134e4202b1e571b37d84b6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.926197 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb73f25-c780-40a8-bc76-392e41ff6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.931495 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5eb73f25-c780-40a8-bc76-392e41ff6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.936728 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8ca753-f1e7-4a9a-9465-d82c1766b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.941262 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8ca753-f1e7-4a9a-9465-d82c1766b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '67212e0f-ffde-4831-aa2d-42ac20d52b2b', 'volume_name': 'volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b', 'volume_size': 1, 'snapshot_id': '3ff24033-a83e-4600-8682-c2520dc3db73'}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.947562 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5367f279-f9ac-40be-8dd2-559192cb373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.952431 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5367f279-f9ac-40be-8dd2-559192cb373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:01.965247 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abacd51-3fef-4977-a5e6-b32358f9d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:01.966690 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Volume 67212e0f-ffde-4831-aa2d-42ac20d52b2b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b', 'volume_size': 1, 'snapshot_id': '3ff24033-a83e-4600-8682-c2520dc3db73'}
Aug 27 21:25:02.018329 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] cloning volumes/volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a@snapshot-3ff24033-a83e-4600-8682-c2520dc3db73 to volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b {{(pid=185274) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1094}}
Aug 27 21:25:02.018976 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.106511 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.220256 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c38d54-8d3a-4a94-a866-812c6db74cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac700fa0>}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.225425 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37540d8-1fea-41d8-a629-fb9ede009d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.230675 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37540d8-1fea-41d8-a629-fb9ede009d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.235888 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f54d4fe-5e5f-459b-9953-25ec7d2c4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.237461 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac700fa0>}
Aug 27 21:25:02.238031 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Cloning 666307a6-8467-4390-93c8-75c3338064e9 from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=185274) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:25:02.238675 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:02.259488 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=185274) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:02.279010 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Flow 'volume_create_manager' (58023513-94d4-429c-ba64-8d9faa917bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:02.285479 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3df48-c129-4ae2-b6a2-0cb24de15adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.289697 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.051s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:02.296905 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:25:02.297279 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:25:02.331141 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abacd51-3fef-4977-a5e6-b32358f9d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b', 'volume_size': 1, 'snapshot_id': '3ff24033-a83e-4600-8682-c2520dc3db73'}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.336199 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e58460-a5de-43fd-8af9-459731c8aa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.346389 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e3df48-c129-4ae2-b6a2-0cb24de15adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-358942727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1f4d20b3-93fe-4b27-9e91-8b74b8109088,host='ncdv-master-1@ceph#ceph',id=be70ec61-c1aa-4f1c-9c46-cada650184c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='961cb9c36e454199a32f5dbc80ed2280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='5dcdcddf82554cc98ea2d027f4df49dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(160e8768-3a56-491a-b846-d60b2a64fc44),volume_type_id=160e8768-3a56-491a-b846-d60b2a64fc44)' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.351703 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90484af-c63b-460d-8649-2d6b1e0341b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.355838 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90484af-c63b-460d-8649-2d6b1e0341b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.360748 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ded4ad1-4a8d-4515-962e-9a0a6fcfbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.364673 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ded4ad1-4a8d-4515-962e-9a0a6fcfbf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be70ec61-c1aa-4f1c-9c46-cada650184c7', 'volume_name': 'volume-be70ec61-c1aa-4f1c-9c46-cada650184c7', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.369490 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b477d65-915d-4a14-8405-3c5f89d2c353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.373272 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b477d65-915d-4a14-8405-3c5f89d2c353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.377781 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836ea162-a116-4cac-a56d-03b65a4ff175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.378883 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Volume be70ec61-c1aa-4f1c-9c46-cada650184c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be70ec61-c1aa-4f1c-9c46-cada650184c7', 'volume_size': 1}
Aug 27 21:25:02.379283 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] creating volume 'volume-be70ec61-c1aa-4f1c-9c46-cada650184c7' {{(pid=185274) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:25:02.379965 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.402639 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 2, 325277)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:02.403610 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:02.404147 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:25:02.408438 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b (67212e0f-ffde-4831-aa2d-42ac20d52b2b): created successfully
Aug 27 21:25:02.413325 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66e58460-a5de-43fd-8af9-459731c8aa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.421530 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Flow 'volume_create_manager' (706f319b-1567-43cc-8de1-1a3d309751b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:02.427005 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.137s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:02.428633 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:25:02.443419 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] extra_specs: {} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:25:02.443755 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] extra_specs: {} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:25:02.447655 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836ea162-a116-4cac-a56d-03b65a4ff175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be70ec61-c1aa-4f1c-9c46-cada650184c7', 'volume_size': 1}' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.454185 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb474e-e6e4-4be8-b5bf-72912f1f4827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.478858 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 25, 2, 439227)}. {{(pid=185274) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:25:02.481316 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.image.cache [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=185274) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:25:02.482543 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=185274) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:25:02.487622 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-f482a5f0-b883-4c23-97f9-918a8fef00d0 tempest-VolumesSnapshotTestJSON-104348141 None] Created volume successfully.
Aug 27 21:25:02.498742 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.flows.manager.create_volume [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Volume volume-be70ec61-c1aa-4f1c-9c46-cada650184c7 (be70ec61-c1aa-4f1c-9c46-cada650184c7): created successfully
Aug 27 21:25:02.502621 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9feb474e-e6e4-4be8-b5bf-72912f1f4827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:02.510493 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Flow 'volume_create_manager' (58023513-94d4-429c-ba64-8d9faa917bdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=185274) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:02.518642 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.595764 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] creating snapshot='volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f54d4fe-5e5f-459b-9953-25ec7d2c4952) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]: 5 predecessors (most recent first):
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7e2c70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': None}
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7e2c70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac700fa0>}}
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'snapshot_id': None, 'source_volid': None, 'volume_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume': {'id': '666307a6-8467-4390-93c8-75c3338064e9', '_name_id': None, 'ec2_id': None, 'user_id': 'f89258f563db4e10a40153d2726c476a', 'project_id': '66298860789b4efa821b1168a8d982ec', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-27T21:24:43.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-666307a6-8467-4390-93c8-75c3338064e9', 'name_id': '666307a6-8467-4390-93c8-75c3338064e9', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-TestVolumeBackupRestore-volume-1976777550', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': '66298860789b4efa821b1168a8d982ec', 'qos_specs': None, 'reservations': ['9cd5ccec-3a44-4102-b695-745c39de68dc', '9d4df70d-1270-4d21-90c1-8cbe8aa503a0', '5cdfe8bf-f1c6-437d-aeb2-ec0003c96255', 'a6ed8eda-96fa-4cca-adbc-ffa49f3177cc'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'f89258f563db4e10a40153d2726c476a', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 3, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(666307a6-8467-4390-93c8-75c3338064e9),volume_id=666307a6-8467-4390-93c8-75c3338064e9,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'context': <cinder.context.RequestContext object at 0x7f51ac7e2c70>}, 'provides': None}
Aug 27 21:25:02.619098 ncdv-master-1 cinder-volume[185274]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7e2c70>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1976777550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=666307a6-8467-4390-93c8-75c3338064e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66298860789b4efa821b1168a8d982ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:02Z,use_quota=True,user_id='f89258f563db4e10a40153d2726c476a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return fut.result()
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     return self.__get_result()
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     raise self._exception
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:02.619914 ncdv-master-1 cinder-volume[185274]: ERROR cinder.volume.manager 
Aug 27 21:25:02.638360 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f54d4fe-5e5f-459b-9953-25ec7d2c4952) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.642386 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f54d4fe-5e5f-459b-9953-25ec7d2c4952) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:02.647441 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37540d8-1fea-41d8-a629-fb9ede009d89) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.653107 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b37540d8-1fea-41d8-a629-fb9ede009d89) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:02.659528 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c38d54-8d3a-4a94-a866-812c6db74cac) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.664019 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c38d54-8d3a-4a94-a866-812c6db74cac) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:02.668973 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ee4c-f366-4e90-9003-d7c95d048660) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.670429 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Updating volume 666307a6-8467-4390-93c8-75c3338064e9 with {'scheduled_at': datetime.datetime(2022, 8, 27, 21, 25, 2, 670042), 'host': None}. {{(pid=185274) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 27 21:25:02.677723 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-87cdeba2-cdb5-4371-a5c5-591908045ad0 tempest-GroupsV314Test-657961322 None] Created volume successfully.
Aug 27 21:25:02.683494 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduling SchedulerAPI.create_volume attempt 3 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap') {{(pid=185274) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 27 21:25:02.692384 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-67212e0f-ffde-4831-aa2d-42ac20d52b2b-delete_volume" by "delete_volume" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:02.711703 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-67212e0f-ffde-4831-aa2d-42ac20d52b2b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:02.721349 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Volume 666307a6-8467-4390-93c8-75c3338064e9: re-scheduled {{(pid=185274) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 27 21:25:02.722003 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.767655 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.drivers.rbd [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] volume volume-666307a6-8467-4390-93c8-75c3338064e9 no longer exists in backend
Aug 27 21:25:02.790443 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c3ee4c-f366-4e90-9003-d7c95d048660) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 27 21:25:02.798765 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1b5d-2af6-496e-86f9-4ee1fa08d8f0) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=185274) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:02.805397 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23af1b5d-2af6-496e-86f9-4ee1fa08d8f0) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:25:02.815988 ncdv-master-1 cinder-volume[185274]: WARNING cinder.volume.manager [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Flow 'volume_create_manager' (05b6f904-8412-4fe2-ad0e-d229bc1445e9) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server [None req-b1fdbda6-e9ba-4243-aa36-172111339529 tempest-TestVolumeBackupRestore-39665972 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-666307a6-8467-4390-93c8-75c3338064e9.clone_snap')
Aug 27 21:25:02.819010 ncdv-master-1 cinder-volume[185274]: ERROR oslo_messaging.rpc.server 
Aug 27 21:25:02.858648 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:02.921726 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:25:02.930173 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] deleting rbd volume volume-67212e0f-ffde-4831-aa2d-42ac20d52b2b {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:25:03.165280 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['70526e78-6309-4e0e-9e5d-c7c2f001c03e', 'd686d653-be43-4600-8676-49a2caff7564', 'fccc63f0-7a13-40f5-b1d8-fda9835ba9d1', '82a132c6-889e-44e3-aaeb-f6df4ec321d2'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:03.228557 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:03.291385 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:03.349073 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:03.356256 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Deleted volume successfully.
Aug 27 21:25:03.376223 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-8cc62297-47fe-4744-ac00-b6548ff0e544 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-67212e0f-ffde-4831-aa2d-42ac20d52b2b-delete_volume" released by "delete_volume" :: held 0.665s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:03.950407 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-3ff24033-a83e-4600-8682-c2520dc3db73-delete_snapshot" by "delete_snapshot" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:03.960532 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:04.024414 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] creating snapshot='volume-8c909075-c508-4dcc-af64-fb1c362611a8.clone_snap' {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:25:04.184881 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] cloning 'volume-be70ec61-c1aa-4f1c-9c46-cada650184c7@volume-8c909075-c508-4dcc-af64-fb1c362611a8.clone_snap' to 'volume-8c909075-c508-4dcc-af64-fb1c362611a8' {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 27 21:25:04.196450 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-3ff24033-a83e-4600-8682-c2520dc3db73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.246s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:04.202917 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:04.338050 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] Volume volume-be70ec61-c1aa-4f1c-9c46-cada650184c7 is not a clone. {{(pid=185274) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:25:04.349697 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] extra_specs: {} {{(pid=185274) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:25:04.350021 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] extra_specs: {} {{(pid=185274) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:25:04.382014 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] clone created successfully {{(pid=185274) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 27 21:25:04.425903 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=66,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=5 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:04.447800 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-d8249be8-361f-4fb0-9d86-382d89fe4d44 tempest-GroupsV314Test-657961322 None] Create group from source-group-1f4d20b3-93fe-4b27-9e91-8b74b8109088 completed successfully.
Aug 27 21:25:05.359374 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['7807d9bd-5271-486a-a643-d4111c96a0ed', '5511288b-2d61-464c-9e62-41946336b467', '8ad9f94c-89cc-4709-8d98-834a0369007b', '3f453f5f-2192-458c-9626-964abf990dd7'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:05.485998 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] Delete snapshot completed successfully.
Aug 27 21:25:05.499459 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-53bed2dc-4b6e-4db5-9ca9-2df1b6d4a1ae tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-3ff24033-a83e-4600-8682-c2520dc3db73-delete_snapshot" released by "delete_snapshot" :: held 1.303s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:05.867177 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=74,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=2 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:05.871213 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:05.974432 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:25:05.984573 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] deleting rbd volume volume-8c909075-c508-4dcc-af64-fb1c362611a8 {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:25:06.374615 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] volume is a clone so cleaning references {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 27 21:25:06.401967 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Volume volume-be70ec61-c1aa-4f1c-9c46-cada650184c7 is not a clone. {{(pid=185274) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:25:06.402716 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] deleting parent snapshot volume-8c909075-c508-4dcc-af64-fb1c362611a8.clone_snap {{(pid=185274) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 27 21:25:07.235140 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-4c00caa8-f392-4f61-b6b8-768fe14aa20a-delete_volume" by "delete_volume" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:07.260018 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-4c00caa8-f392-4f61-b6b8-768fe14aa20a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:07.317945 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Created reservations ['78dc3eda-371b-4776-814d-2b442b3731bf'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:07.327583 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:07.400153 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:25:07.400784 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Volume volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a is not a clone. {{(pid=185274) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:25:07.408367 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] deleting rbd volume volume-4c00caa8-f392-4f61-b6b8-768fe14aa20a {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:25:07.460589 ncdv-master-1 cinder-volume[185274]: WARNING cinder.quota [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1741673913 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1741673913, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:25:07.462186 ncdv-master-1 cinder-volume[185274]: WARNING cinder.quota [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1741673913 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1741673913, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:25:07.485996 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Created reservations ['60232a7f-e2a5-4f4d-8416-837414d584ac', '8f30fdbc-2f2b-4489-bcd7-424305ca28ec', 'cfe2a9ea-0bf4-420b-8dbf-90a76dca08a3', 'baaca116-0a3c-4fc5-88eb-4259bfb19579'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:07.655509 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:07.717781 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:07.749356 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:07.765902 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-e80a5309-d51c-4fd8-9b51-02415193cca2 tempest-GroupsV314Test-657961322 None] Delete group completed successfully.
Aug 27 21:25:07.798811 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Created reservations ['21898f82-2eec-41ac-9d80-a6c7e0ef2b1f', '9fa3e988-105a-4f04-8eef-716183a1fb1e', 'eb8bcec7-7a6e-48ba-a3c8-f2fb272e9b9e', '31fb1450-be07-434e-b105-75a9108cc3fe'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:07.864737 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:07.925216 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:07.967903 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.manager [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Notifying Schedulers of capabilities ... {{(pid=185274) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:07.980971 ncdv-master-1 cinder-volume[185274]: INFO cinder.volume.manager [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Deleted volume successfully.
Aug 27 21:25:08.003213 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-5da1a967-3b50-4058-81b2-db8df51066f0 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-4c00caa8-f392-4f61-b6b8-768fe14aa20a-delete_volume" released by "delete_volume" :: held 0.741s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:08.559110 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:08.622165 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] volume has no backup snaps {{(pid=185274) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:25:08.622676 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] Volume volume-be70ec61-c1aa-4f1c-9c46-cada650184c7 is not a clone. {{(pid=185274) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:25:08.633221 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] deleting rbd volume volume-be70ec61-c1aa-4f1c-9c46-cada650184c7 {{(pid=185274) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:25:08.853342 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-0de2412e-3e47-4f8a-9c36-68182b404180 tempest-VolumesSnapshotTestJSON-104348141 None] Acquiring lock "cinder-b35d7708-7a33-4abe-9eef-b0b075fd5f1d-delete_snapshot" by "delete_snapshot" {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:08.872302 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.coordination [None req-0de2412e-3e47-4f8a-9c36-68182b404180 tempest-VolumesSnapshotTestJSON-104348141 None] Lock "cinder-b35d7708-7a33-4abe-9eef-b0b075fd5f1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=185274) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:08.874115 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.volume.drivers.rbd [None req-0de2412e-3e47-4f8a-9c36-68182b404180 tempest-VolumesSnapshotTestJSON-104348141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=185274) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.006872 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] Created reservations ['bd007c0f-a2f8-4229-81b1-9865ea393fc9'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:09.047421 ncdv-master-1 cinder-volume[185274]: DEBUG cinder.quota [None req-5bff3aa0-4c3e-449d-8cd1-472ab94ffe63 tempest-GroupsV314Test-657961322 None] Created reservations ['bde4df38-50a4-4a0c-a82b-3230260a8a26', 'ce34f57f-59ce-4531-81d8-2242e70c6920', '07f58c7a-d562-49ee-b0b9-49cf36d44a22', '77c1b6a2-c2d9-461f-84c8-146e35535fd8'] {{(pid=185274) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:09.109663 ncdv-master-1 cinder-volume[185274]: DEBUG dbcounter [-] [185274] Writing DB stats cinder:SELECT=50,cinder:INSERT=11,cinder:UPDATE=39 {{(pid=185274) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:09.179259 ncdv-master-1 cinder-volume[133218]: INFO oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Child 185274 killed by signal 11
Aug 27 21:25:09.188192 ncdv-master-1 cinder-volume[133218]: DEBUG oslo_service.service [None req-4eea441c-276d-448a-9031-c1ba7d1d3d99 None None] Started child 187057 {{(pid=133218) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Aug 27 21:25:09.199982 ncdv-master-1 cinder-volume[187057]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Aug 27 21:25:09.253348 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Starting volume driver RBDDriver (1.2.0)
Aug 27 21:25:09.255509 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.299170 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.353454 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.404200 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.driver [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Driver hasn't implemented _init_vendor_properties()
Aug 27 21:25:09.405155 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.driver [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.79, 'free_capacity_gb': 19.34, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:f60509cb-0788-4b7d-926f-6a9af5c8f250:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=187057) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Aug 27 21:25:09.428642 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_db.sqlalchemy.engines [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=187057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 27 21:25:09.432602 ncdv-master-1 cinder-volume[187057]: DEBUG dbcounter [-] [187057] Writer thread running {{(pid=187057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 27 21:25:09.480253 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.db.sqlalchemy.api [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Building query based on filter {{(pid=187057) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Aug 27 21:25:09.526672 ncdv-master-1 cinder-volume[187057]: INFO cinder.keymgr.migration [None req-048cc443-b3c8-4e05-a0d4-9a36f98b4981 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 27 21:25:09.529231 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.581856 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.624919 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Notifying Schedulers of capabilities ... {{(pid=187057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:09.691459 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Driver initialization completed successfully.
Aug 27 21:25:09.692175 ncdv-master-1 cinder-volume[187057]: INFO cinder.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Initiating service 3 cleanup
Aug 27 21:25:09.704058 ncdv-master-1 cinder-volume[187057]: INFO cinder.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Service 3 cleanup completed.
Aug 27 21:25:09.704413 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.service [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Creating RPC server for service cinder-volume {{(pid=187057) start /opt/stack/cinder/cinder/service.py:238}}
Aug 27 21:25:09.723827 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.service [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=187057) start /opt/stack/cinder/cinder/service.py:244}}
Aug 27 21:25:09.786270 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Aug 27 21:25:09.787485 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.878939 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:09.972263 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-55c49eaf-5dd2-49c2-9c13-4e3edbc34417 None None] Driver post RPC initialization completed successfully.
Aug 27 21:25:19.702403 ncdv-master-1 cinder-volume[187057]: DEBUG dbcounter [-] [187057] Writing DB stats cinder:SELECT=5 {{(pid=187057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:19.969021 ncdv-master-1 cinder-volume[187057]: DEBUG dbcounter [-] [187057] Writing DB stats cinder:SELECT=7 {{(pid=187057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:20.963025 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=187057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:21.007738 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Flow 'volume_create_manager' (6c3b4f77-14a6-40b4-afe7-e653a0cdd683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:21.014007 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5585b04-c6fd-4e18-9095-b3fe2e3cbc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.063368 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5585b04-c6fd-4e18-9095-b3fe2e3cbc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-470439433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=7bd87428-c168-4336-b081-0e96806c27de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='625b861c5dff48f484885d839db662f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:21Z,use_quota=True,user_id='32d981c00dcf41d5a2ed055a5d88132a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.068272 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20905ae-2166-457c-a691-5f3ef6efe84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.072861 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d20905ae-2166-457c-a691-5f3ef6efe84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.077386 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2471e32d-7f00-4027-8074-e955b9858bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.081177 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2471e32d-7f00-4027-8074-e955b9858bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd87428-c168-4336-b081-0e96806c27de', 'volume_name': 'volume-7bd87428-c168-4336-b081-0e96806c27de', 'volume_size': 1}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.086003 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a6424-4222-41a7-9840-b585f064581f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.089648 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5a6424-4222-41a7-9840-b585f064581f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.093771 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735ceed5-c2d5-4c10-aee1-ba0633028a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.094810 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Volume 7bd87428-c168-4336-b081-0e96806c27de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd87428-c168-4336-b081-0e96806c27de', 'volume_size': 1}
Aug 27 21:25:21.095231 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] creating volume 'volume-7bd87428-c168-4336-b081-0e96806c27de' {{(pid=187057) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:25:21.095981 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:21.173297 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=187057) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:25:21.173823 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=187057) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:25:21.180351 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735ceed5-c2d5-4c10-aee1-ba0633028a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd87428-c168-4336-b081-0e96806c27de', 'volume_size': 1}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.184898 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91509d9f-f46a-41da-a06d-7d0a3a74f093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:21.197000 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Volume volume-7bd87428-c168-4336-b081-0e96806c27de (7bd87428-c168-4336-b081-0e96806c27de): created successfully
Aug 27 21:25:21.200628 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91509d9f-f46a-41da-a06d-7d0a3a74f093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:21.205968 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Flow 'volume_create_manager' (6c3b4f77-14a6-40b4-afe7-e653a0cdd683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:21.218524 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-9e49661a-cf44-4a5e-a9cf-ec6b4148f5f9 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Created volume successfully.
Aug 27 21:25:22.201126 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3c8b1365-4f12-454c-b36f-7c2118845ff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:23.128303 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-3c8b1365-4f12-454c-b36f-7c2118845ff5 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Create snapshot completed successfully
Aug 27 21:25:23.602485 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Acquiring lock "cinder-b307a76f-271e-4c4b-8d9c-56f2a605695e-delete_snapshot" by "delete_snapshot" {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:23.613819 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Lock "cinder-b307a76f-271e-4c4b-8d9c-56f2a605695e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:23.615268 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:24.134984 ncdv-master-1 cinder-volume[187057]: WARNING cinder.quota [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:25:24.135841 ncdv-master-1 cinder-volume[187057]: WARNING cinder.quota [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:25:24.159497 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.quota [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Created reservations ['cc16e9c9-5cc7-4618-a8d1-1b83d5c42e2b', 'bca077e2-1937-49af-8a1d-ffc4d844773c', '40cb1df7-3153-438b-82a6-7b438cbd5de8', '508ebc88-0845-45d6-b67d-a1994eb1e124'] {{(pid=187057) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:24.217017 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Delete snapshot completed successfully.
Aug 27 21:25:24.223792 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-683bb7ed-d84a-426a-bd7c-396008d94003 tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Lock "cinder-b307a76f-271e-4c4b-8d9c-56f2a605695e-delete_snapshot" released by "delete_snapshot" :: held 0.610s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:24.717769 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Acquiring lock "cinder-7bd87428-c168-4336-b081-0e96806c27de-delete_volume" by "delete_volume" {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:24.736847 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Lock "cinder-7bd87428-c168-4336-b081-0e96806c27de-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:24.775599 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:24.817254 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] volume has no backup snaps {{(pid=187057) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 27 21:25:24.817785 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Volume volume-7bd87428-c168-4336-b081-0e96806c27de is not a clone. {{(pid=187057) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:25:24.823172 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] deleting rbd volume volume-7bd87428-c168-4336-b081-0e96806c27de {{(pid=187057) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:25:24.978965 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_service.periodic_task [None req-de8928e0-47b4-4a46-98cd-67703774cbba None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=187057) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 27 21:25:24.979762 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-de8928e0-47b4-4a46-98cd-67703774cbba None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:25.005180 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-de8928e0-47b4-4a46-98cd-67703774cbba None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:25.030790 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.manager [None req-de8928e0-47b4-4a46-98cd-67703774cbba None None] Notifying Schedulers of capabilities ... {{(pid=187057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:25.057885 ncdv-master-1 cinder-volume[187057]: WARNING cinder.quota [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 27 21:25:25.076882 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.quota [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Created reservations ['f9cba7dd-35d0-40bf-b4ba-5f5b63b1013d', '64e16398-752b-443d-a266-28e264dcd252', 'd9634023-72f7-47b9-ae0c-103fcaaeb5b2', 'b0b0ef55-53a1-4cf7-a96b-ba3a9ea66da6'] {{(pid=187057) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:25:25.131773 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:25.155527 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:25.180606 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.manager [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Notifying Schedulers of capabilities ... {{(pid=187057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:25:25.184986 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Deleted volume successfully.
Aug 27 21:25:25.199021 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-3edaa6c9-ca9b-4840-8af6-d890c3a96f2c tempest-VolumeSnapshotQuotasNegativeTestJSON-727071601 None] Lock "cinder-7bd87428-c168-4336-b081-0e96806c27de-delete_volume" released by "delete_volume" :: held 0.463s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:25:33.411116 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=187057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:25:33.431838 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (e522712f-2e57-4ef0-9876-c63c3e57d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:33.438271 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2760c59-c801-4c99-a0e1-0af778cdc584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.454651 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2760c59-c801-4c99-a0e1-0af778cdc584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-132021304',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=aac109c2-38c9-422c-8c60-64286b1ad8a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:25:33Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.460362 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503e43a5-5083-4701-b2f4-ba21923d4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.464613 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503e43a5-5083-4701-b2f4-ba21923d4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.469614 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad34c4f-9086-43b0-8ec1-9220b6e0db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.473627 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad34c4f-9086-43b0-8ec1-9220b6e0db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aac109c2-38c9-422c-8c60-64286b1ad8a4', 'volume_name': 'volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'volume_size': 1}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.478461 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1550008c-05a5-4bc4-8842-4221fef974f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.482322 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1550008c-05a5-4bc4-8842-4221fef974f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.487004 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d5eb41-fee4-47ba-8af5-69e4e09f0291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.488097 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Volume aac109c2-38c9-422c-8c60-64286b1ad8a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'volume_size': 1}
Aug 27 21:25:33.488554 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] creating volume 'volume-aac109c2-38c9-422c-8c60-64286b1ad8a4' {{(pid=187057) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 27 21:25:33.489253 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:25:33.546484 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=187057) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 27 21:25:33.546869 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=187057) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 27 21:25:33.550741 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d5eb41-fee4-47ba-8af5-69e4e09f0291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'volume_size': 1}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.555310 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc35e53c-2c1d-4aa7-ab23-102a6e9b7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:25:33.567129 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Volume volume-aac109c2-38c9-422c-8c60-64286b1ad8a4 (aac109c2-38c9-422c-8c60-64286b1ad8a4): created successfully
Aug 27 21:25:33.572212 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc35e53c-2c1d-4aa7-ab23-102a6e9b7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:25:33.577635 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (e522712f-2e57-4ef0-9876-c63c3e57d852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:25:33.589496 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-bc8325cb-d625-4d42-a050-f4eb4748749c tempest-VolumesBackupsTest-865856394 None] Created volume successfully.
Aug 27 21:25:47.457154 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_concurrency.processutils [req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b req-13a979ec-ad0a-4eb1-9028-10c84cfc1d63 tempest-VolumesBackupsTest-865856394 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=187057) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:25:48.195787 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_concurrency.processutils [req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b req-13a979ec-ad0a-4eb1-9028-10c84cfc1d63 tempest-VolumesBackupsTest-865856394 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.738s {{(pid=187057) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:25:48.196654 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b req-13a979ec-ad0a-4eb1-9028-10c84cfc1d63 tempest-VolumesBackupsTest-865856394 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'aac109c2-38c9-422c-8c60-64286b1ad8a4', 'discard': True}} {{(pid=187057) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:25:48.243961 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b req-13a979ec-ad0a-4eb1-9028-10c84cfc1d63 tempest-VolumesBackupsTest-865856394 None] Connection info returned from driver {'name': 'volumes/volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aac109c2-38c9-422c-8c60-64286b1ad8a4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'aaafbd1b-e532-43e3-8647-ae4f2f72035a'} {{(pid=187057) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 27 21:25:48.303536 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [req-a1dd7a7e-c099-4606-a0bd-41c3a0ba0b7b req-13a979ec-ad0a-4eb1-9028-10c84cfc1d63 tempest-VolumesBackupsTest-865856394 None] attachment_update completed successfully.
Aug 27 21:25:49.973271 ncdv-master-1 cinder-volume[187057]: DEBUG dbcounter [-] [187057] Writing DB stats cinder:SELECT=48,cinder:UPDATE=22,cinder:DELETE=2,cinder:INSERT=5 {{(pid=187057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:49.975107 ncdv-master-1 cinder-volume[187057]: DEBUG dbcounter [-] [187057] Writing DB stats cinder:SELECT=51,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=187057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 27 21:25:50.526541 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-27T21:25:50Z,data_timestamp=2022-08-27T21:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1251158221',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=31b90799-e83e-413c-8998-0700022b767a,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='c8abb21b54024d278659683e08e04633',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='8c40d90fca40448bad028604c202d6a8',volume_id=aac109c2-38c9-422c-8c60-64286b1ad8a4)
Aug 27 21:25:50.532216 ncdv-master-1 cinder-volume[187057]: INFO cinder.rpc [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Aug 27 21:25:50.537176 ncdv-master-1 cinder-volume[187057]: INFO cinder.rpc [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Aug 27 21:25:50.538027 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.backup.rpcapi [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] continue_backup in rpcapi backup_id 31b90799-e83e-413c-8998-0700022b767a {{(pid=187057) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 27 21:25:50.654792 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_concurrency.processutils [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=187057) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 27 21:25:51.405967 ncdv-master-1 cinder-volume[187057]: DEBUG oslo_concurrency.processutils [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.751s {{(pid=187057) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 27 21:25:51.407526 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aac109c2-38c9-422c-8c60-64286b1ad8a4', 'hosts': ['10.222.0.40'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': '258cf4ee-ed22-4beb-8f24-21132fbd771d', 'volume_id': 'aac109c2-38c9-422c-8c60-64286b1ad8a4', 'discard': True}} {{(pid=187057) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 27 21:25:51.425907 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Initialize volume connection completed successfully.
Aug 27 21:25:53.291241 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Terminate volume connection completed successfully.
Aug 27 21:25:53.309865 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-8cf7c487-9eb7-439a-9efc-5f5c4e756223 tempest-VolumesBackupsTest-865856394 None] Remove volume export completed successfully.
Aug 27 21:25:55.689133 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 req-ce27a925-4e5e-4b3f-aa4b-e59aceaf26d4 tempest-VolumesBackupsTest-865856394 None] Terminate volume connection completed successfully.
Aug 27 21:25:55.690228 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [req-dd5f8812-6b39-49ac-ba93-6ad5468087a2 req-ce27a925-4e5e-4b3f-aa4b-e59aceaf26d4 tempest-VolumesBackupsTest-865856394 None] Deleting attachment aaafbd1b-e532-43e3-8647-ae4f2f72035a. {{(pid=187057) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 27 21:25:59.828387 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Acquiring lock "cinder-aac109c2-38c9-422c-8c60-64286b1ad8a4-delete_volume" by "delete_volume" {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:25:59.843688 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-aac109c2-38c9-422c-8c60-64286b1ad8a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:25:59.887071 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:00.040820 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Volume volume-aac109c2-38c9-422c-8c60-64286b1ad8a4 is not a clone. {{(pid=187057) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 27 21:26:00.055370 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] deleting rbd volume volume-aac109c2-38c9-422c-8c60-64286b1ad8a4 {{(pid=187057) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 27 21:26:00.248290 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.quota [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Created reservations ['31d2d572-85b0-4806-acdd-0af7c09f9e88', 'dcd69ef9-efd3-498f-9ce5-3e815bfe2a9d', '9ffafd15-efc4-458c-8ed4-cef32217e774', 'ce61c7e0-a2d4-4db4-8b30-502a39984587'] {{(pid=187057) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 27 21:26:00.302287 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:00.328278 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:00.356846 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.manager [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Notifying Schedulers of capabilities ... {{(pid=187057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 27 21:26:00.362385 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.manager [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Deleted volume successfully.
Aug 27 21:26:00.375991 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-c3abb128-5022-4665-8cb9-e1b52aba2bc0 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-aac109c2-38c9-422c-8c60-64286b1ad8a4-delete_volume" released by "delete_volume" :: held 0.532s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:26:01.403028 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=187057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:26:01.424724 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (ff473520-ac68-4c5a-b151-defa346fae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:26:01.431452 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6ca0e-adc9-4d87-9cfe-9a07557ab766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.449671 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6ca0e-adc9-4d87-9cfe-9a07557ab766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.455062 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bf45ec-86b1-4184-9634-2ac89eecfd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.459587 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bf45ec-86b1-4184-9634-2ac89eecfd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.464593 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109314e-4f6a-4a54-b5bd-99264b5ce429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.561194 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109314e-4f6a-4a54-b5bd-99264b5ce429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac69b790>}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.566181 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2af1eb-02ba-4505-988d-b9d80f2ec302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.570169 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2af1eb-02ba-4505-988d-b9d80f2ec302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.574865 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a3333-b416-4c66-ba2b-c04b49e03937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.576018 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac69b790>}
Aug 27 21:26:01.576612 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Cloning 5d200147-3e01-47c3-84cc-5e171a3dbabe from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=187057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:26:01.577415 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:26:01.586164 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:26:01.604654 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 26, 1, 594625)}. {{(pid=187057) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:26:01.605507 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=187057) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:26:01.606230 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=187057) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:26:01.612863 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.027s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:26:01.614707 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=187057) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:26:01.622800 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 26, 1, 619899)}. {{(pid=187057) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:26:01.623230 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=187057) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:26:01.623767 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=187057) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:26:01.637694 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:01.690608 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] creating snapshot='volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' {{(pid=187057) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a3333-b416-4c66-ba2b-c04b49e03937) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]: 5 predecessors (most recent first):
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7a1100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': None}
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7a1100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5d200147-3e01-47c3-84cc-5e171a3dbabe),volume_id=5d200147-3e01-47c3-84cc-5e171a3dbabe,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac69b790>}}
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'retry': {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']}, 'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'snapshot_id': None, 'source_volid': None, 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume': {'id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', '_name_id': None, 'ec2_id': None, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'project_id': 'c8abb21b54024d278659683e08e04633', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-27T21:26:01.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'name_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'c8abb21b54024d278659683e08e04633', 'qos_specs': None, 'reservations': ['f06cbde6-3252-4989-bcbf-24d9bf211c47', '385f0f0b-83d6-4e59-aabf-92af93a4b75b', '37bb2558-1b9a-4a31-831e-5fb20ee21ff8', '80ec382c-d34f-4c14-bc85-7f1aaf6cf764'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'c8abb21b54024d278659683e08e04633', 'qos_specs': None, 'reservations': ['f06cbde6-3252-4989-bcbf-24d9bf211c47', '385f0f0b-83d6-4e59-aabf-92af93a4b75b', '37bb2558-1b9a-4a31-831e-5fb20ee21ff8', '80ec382c-d34f-4c14-bc85-7f1aaf6cf764'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'metadata': {}, 'qos_specs': None}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5d200147-3e01-47c3-84cc-5e171a3dbabe),volume_id=5d200147-3e01-47c3-84cc-5e171a3dbabe,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'context': <cinder.context.RequestContext object at 0x7f51ac7a1100>}, 'provides': None}
Aug 27 21:26:01.712568 ncdv-master-1 cinder-volume[187057]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac7a1100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:01Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return fut.result()
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return self.__get_result()
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     raise self._exception
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:01.713413 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:01.726090 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a3333-b416-4c66-ba2b-c04b49e03937) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.730083 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a3333-b416-4c66-ba2b-c04b49e03937) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:01.735197 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2af1eb-02ba-4505-988d-b9d80f2ec302) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.739238 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2af1eb-02ba-4505-988d-b9d80f2ec302) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:01.743969 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109314e-4f6a-4a54-b5bd-99264b5ce429) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.748122 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0109314e-4f6a-4a54-b5bd-99264b5ce429) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:01.752781 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bf45ec-86b1-4184-9634-2ac89eecfd93) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.754140 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Updating volume 5d200147-3e01-47c3-84cc-5e171a3dbabe with {'scheduled_at': datetime.datetime(2022, 8, 27, 21, 26, 1, 753718), 'host': None}. {{(pid=187057) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 27 21:26:01.766857 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: re-scheduling SchedulerAPI.create_volume attempt 1 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap') {{(pid=187057) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 27 21:26:01.791280 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: re-scheduled {{(pid=187057) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 27 21:26:01.792343 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:01.831655 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] volume volume-5d200147-3e01-47c3-84cc-5e171a3dbabe no longer exists in backend
Aug 27 21:26:01.840225 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bf45ec-86b1-4184-9634-2ac89eecfd93) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 27 21:26:01.845354 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6ca0e-adc9-4d87-9cfe-9a07557ab766) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.849677 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d6ca0e-adc9-4d87-9cfe-9a07557ab766) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:01.855172 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (ff473520-ac68-4c5a-b151-defa346fae26) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server 
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server 
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:01.860410 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server 
Aug 27 21:26:01.913151 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume reschedule parameters: True retry: {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']} {{(pid=187057) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 27 21:26:01.932820 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (0f564952-6cb0-40db-815c-c6b3b42c2527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 27 21:26:01.939120 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2130e40-873c-438c-ab9d-ae4b815e9638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.956291 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2130e40-873c-438c-ab9d-ae4b815e9638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.962742 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055baf6b-613a-4fd7-9b94-00388f99a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:01.966794 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055baf6b-613a-4fd7-9b94-00388f99a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:01.971824 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcab3e8-389f-48ab-a7ef-66359881bce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.063946 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcab3e8-389f-48ab-a7ef-66359881bce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac49a850>}' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:02.069000 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1c2dd-4634-4633-88cd-0471a4209388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.072970 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1c2dd-4634-4633-88cd-0471a4209388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 27 21:26:02.077630 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc04a3-d4a9-4f51-8ae6-70d6720e16dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.078753 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac49a850>}
Aug 27 21:26:02.079327 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Cloning 5d200147-3e01-47c3-84cc-5e171a3dbabe from image 3c9ca970-c391-4d4a-9934-78cc80446a1e  at location (None, None). {{(pid=187057) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 27 21:26:02.080017 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Acquiring lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" by "_prepare_image_cache_entry" {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 27 21:26:02.089836 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:196}}
Aug 27 21:26:02.096758 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 26, 2, 94008)}. {{(pid=187057) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:26:02.097206 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=187057) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:26:02.097592 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=187057) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 27 21:26:02.101721 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.coordination [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Lock "cinder-3c9ca970-c391-4d4a-9934-78cc80446a1e" released by "_prepare_image_cache_entry" :: held 0.012s {{(pid=187057) _synchronized /opt/stack/cinder/cinder/coordination.py:207}}
Aug 27 21:26:02.102395 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Attempting to retrieve cache entry for image = 3c9ca970-c391-4d4a-9934-78cc80446a1e on host ncdv-master-1@ceph#ceph. {{(pid=187057) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 27 21:26:02.108078 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Found image-volume cache entry: {'id': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'volume_id': 'b64ec5dc-2485-4680-b8d2-3e011c15d8ee', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34), 'last_used': datetime.datetime(2022, 8, 27, 21, 26, 2, 105693)}. {{(pid=187057) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 27 21:26:02.108493 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.image.cache [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Image-volume cache entry image_update_at = 2022-08-27 20:40:34+00:00, requested image updated_at = 2022-08-27 20:40:34+00:00. {{(pid=187057) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 27 21:26:02.108891 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Creating from source image-volume b64ec5dc-2485-4680-b8d2-3e011c15d8ee {{(pid=187057) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 27 21:26:02.121190 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:02.183271 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] creating snapshot='volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' {{(pid=187057) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc04a3-d4a9-4f51-8ae6-70d6720e16dc) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]: 5 predecessors (most recent first):
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac4e80d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': None}
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac4e80d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5d200147-3e01-47c3-84cc-5e171a3dbabe),volume_id=5d200147-3e01-47c3-84cc-5e171a3dbabe,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_size': 1, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '76bf00f811264e51a20ddddb9a100e36', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'created_at': datetime.datetime(2022, 8, 27, 20, 40, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 27, 20, 40, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3c9ca970-c391-4d4a-9934-78cc80446a1e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f51ac49a850>}}
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '3c9ca970-c391-4d4a-9934-78cc80446a1e', 'snapshot_id': None, 'source_volid': None, 'volume_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume': {'id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', '_name_id': None, 'ec2_id': None, 'user_id': '8c40d90fca40448bad028604c202d6a8', 'project_id': 'c8abb21b54024d278659683e08e04633', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-27T21:26:01.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe', 'name_id': '5d200147-3e01-47c3-84cc-5e171a3dbabe', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': 'd234d473-4070-4fdf-b0ed-db33030fbb17', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-27T20:40:01.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'c8abb21b54024d278659683e08e04633', 'qos_specs': None, 'reservations': ['f06cbde6-3252-4989-bcbf-24d9bf211c47', '385f0f0b-83d6-4e59-aabf-92af93a4b75b', '37bb2558-1b9a-4a31-831e-5fb20ee21ff8', '80ec382c-d34f-4c14-bc85-7f1aaf6cf764'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-2072356658', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'c8abb21b54024d278659683e08e04633', 'qos_specs': None, 'reservations': ['f06cbde6-3252-4989-bcbf-24d9bf211c47', '385f0f0b-83d6-4e59-aabf-92af93a4b75b', '37bb2558-1b9a-4a31-831e-5fb20ee21ff8', '80ec382c-d34f-4c14-bc85-7f1aaf6cf764'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'volume_type_id': 'd234d473-4070-4fdf-b0ed-db33030fbb17'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-27T20:40:01Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=d234d473-4070-4fdf-b0ed-db33030fbb17,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': '8c40d90fca40448bad028604c202d6a8', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=3c9ca970-c391-4d4a-9934-78cc80446a1e,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5d200147-3e01-47c3-84cc-5e171a3dbabe),volume_id=5d200147-3e01-47c3-84cc-5e171a3dbabe,volume_properties=VolumeProperties,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17), 'context': <cinder.context.RequestContext object at 0x7f51ac4e80d0>}, 'provides': None}
Aug 27 21:26:02.202052 ncdv-master-1 cinder-volume[187057]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f51ac4e80d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-27T21:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-2072356658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5d200147-3e01-47c3-84cc-5e171a3dbabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8abb21b54024d278659683e08e04633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-27T21:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-27T21:26:02Z,use_quota=True,user_id='8c40d90fca40448bad028604c202d6a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d234d473-4070-4fdf-b0ed-db33030fbb17),volume_type_id=d234d473-4070-4fdf-b0ed-db33030fbb17)}
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return fut.result()
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     return self.__get_result()
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     raise self._exception
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:02.202748 ncdv-master-1 cinder-volume[187057]: ERROR cinder.volume.manager 
Aug 27 21:26:02.215371 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc04a3-d4a9-4f51-8ae6-70d6720e16dc) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.219196 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fc04a3-d4a9-4f51-8ae6-70d6720e16dc) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:02.224255 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1c2dd-4634-4633-88cd-0471a4209388) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.227894 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1c2dd-4634-4633-88cd-0471a4209388) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:02.232608 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcab3e8-389f-48ab-a7ef-66359881bce8) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.236699 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcab3e8-389f-48ab-a7ef-66359881bce8) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:02.241275 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055baf6b-613a-4fd7-9b94-00388f99a582) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.242583 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Updating volume 5d200147-3e01-47c3-84cc-5e171a3dbabe with {'scheduled_at': datetime.datetime(2022, 8, 27, 21, 26, 2, 242168), 'host': None}. {{(pid=187057) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 27 21:26:02.255882 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: re-scheduling SchedulerAPI.create_volume attempt 2 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap') {{(pid=187057) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 27 21:26:02.275818 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Volume 5d200147-3e01-47c3-84cc-5e171a3dbabe: re-scheduled {{(pid=187057) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 27 21:26:02.276550 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=187057) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 27 21:26:02.311326 ncdv-master-1 cinder-volume[187057]: INFO cinder.volume.drivers.rbd [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] volume volume-5d200147-3e01-47c3-84cc-5e171a3dbabe no longer exists in backend
Aug 27 21:26:02.324702 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (055baf6b-613a-4fd7-9b94-00388f99a582) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 27 21:26:02.329360 ncdv-master-1 cinder-volume[187057]: DEBUG cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2130e40-873c-438c-ab9d-ae4b815e9638) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=187057) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 27 21:26:02.333888 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2130e40-873c-438c-ab9d-ae4b815e9638) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 27 21:26:02.339006 ncdv-master-1 cinder-volume[187057]: WARNING cinder.volume.manager [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Flow 'volume_create_manager' (0f564952-6cb0-40db-815c-c6b3b42c2527) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server [None req-d7233c3f-c378-4d39-bcaa-fcb529727404 tempest-VolumesBackupsTest-865856394 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap' from b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee')
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server 
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server 
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     raise value
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-b64ec5dc-2485-4680-b8d2-3e011c15d8ee'@b'volume-5d200147-3e01-47c3-84cc-5e171a3dbabe.clone_snap')
Aug 27 21:26:02.341200 ncdv-master-1 cinder-volume[187057]: ERROR oslo_messaging.rpc.server