-- Logs begin at Sat 2022-08-06 20:01:12 UTC, end at Sat 2022-08-06 22:19:43 UTC. --
Aug 06 20:44:46.656575 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service.
Aug 06 20:44:50.039746 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=135515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}}
Aug 06 20:44:50.040599 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=135515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}}
Aug 06 20:44:50.040599 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=135515) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}}
Aug 06 20:44:50.460071 ncdv-master-1 cinder-volume[135515]: INFO dbcounter [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Registered counter for database cinder
Aug 06 20:44:50.484122 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_db.sqlalchemy.engines [None req-4996b777-9f10-4796-9279-9980b257b25b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 20:44:50.490969 ncdv-master-1 cinder-volume[135515]: DEBUG dbcounter [-] [135515] Writer thread running {{(pid=135515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 06 20:44:50.718452 ncdv-master-1 cinder-volume[135515]: INFO cinder.rpc [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 06 20:44:50.723563 ncdv-master-1 cinder-volume[135515]: INFO cinder.rpc [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 06 20:44:50.733050 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_db.sqlalchemy.engines [None req-4996b777-9f10-4796-9279-9980b257b25b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 20:44:50.900647 ncdv-master-1 cinder-volume[135515]: INFO cinder.volume.manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Determined volume DB was empty at startup.
Aug 06 20:44:50.901952 ncdv-master-1 cinder-volume[135515]: DEBUG cinder.volume.manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=135515) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}}
Aug 06 20:44:50.913558 ncdv-master-1 cinder-volume[135515]: INFO cinder.volume.manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 06 20:44:50.914836 ncdv-master-1 cinder-volume[135515]: WARNING stevedore.named [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 06 20:44:50.915285 ncdv-master-1 cinder-volume[135515]: WARNING castellan.key_manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 06 20:44:50.916609 ncdv-master-1 cinder-volume[135515]: WARNING cinder.keymgr.conf_key_mgr [None req-4996b777-9f10-4796-9279-9980b257b25b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 06 20:44:50.934155 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_db.sqlalchemy.engines [None req-4996b777-9f10-4796-9279-9980b257b25b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 20:44:50.939512 ncdv-master-1 cinder-volume[135515]: INFO cinder.rpc [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 06 20:44:50.944807 ncdv-master-1 cinder-volume[135515]: INFO cinder.rpc [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version.
Aug 06 20:44:50.945985 ncdv-master-1 cinder-volume[135515]: WARNING stevedore.named [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 06 20:44:50.946609 ncdv-master-1 cinder-volume[135515]: WARNING castellan.key_manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 06 20:44:50.948842 ncdv-master-1 cinder-volume[135515]: INFO cinder.volume.manager [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Image-volume cache enabled for host ncdv-master-1@ceph.
Aug 06 20:44:50.955852 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_db.sqlalchemy.engines [None req-4996b777-9f10-4796-9279-9980b257b25b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135515) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 20:44:50.974971 ncdv-master-1 cinder-volume[135515]: INFO oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Starting 1 workers
Aug 06 20:44:50.979964 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Started child 135688 {{(pid=135515) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Aug 06 20:44:50.981040 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Full set of CONF: {{(pid=135515) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}}
Aug 06 20:44:50.981403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ******************************************************************************** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}}
Aug 06 20:44:50.981898 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Configuration options gathered from: {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}}
Aug 06 20:44:50.982531 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}}
Aug 06 20:44:50.983196 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}}
Aug 06 20:44:50.983636 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ================================================================================ {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}}
Aug 06 20:44:50.984637 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] allow_availability_zone_fallback = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.985193 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] allow_compression_on_image_upload = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.985850 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] allowed_direct_url_schemes     = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.986445 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] api_rate_limit                 = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.987398 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] auth_strategy                  = keystone {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.988032 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] az_cache_duration              = 3600 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.988412 ncdv-master-1 cinder-volume[135688]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Aug 06 20:44:50.989237 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_availability_zone      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.989814 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_host                   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.990207 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_name                   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.990656 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_stats_polling_interval = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.991052 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backup_api_class               = cinder.backup.api.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.991441 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.991847 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backup_name_template           = backup-%s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.992369 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backup_use_same_host           = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.992763 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backup_use_temp_snapshot       = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.993154 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] chap_password                  = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.993536 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] chap_username                  =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.993947 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.994374 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_internal_tenant_project_id = 6c4962342201407a89793c5c9a6a6f36 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.994837 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_internal_tenant_user_id = 60cf8ac27ec04117937e87749d69fe3f {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.995199 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cloned_volume_same_az          = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.995545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cluster                        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.995941 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] compression_format             = gzip {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.996373 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] compute_api_class              = cinder.compute.nova.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.996969 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] config_dir                     = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.997498 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.998040 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] config_source                  = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.998606 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.999159 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] control_exchange               = openstack {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:50.999691 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] debug                          = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.000190 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] default_availability_zone      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.000826 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] default_group_type             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.001670 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.002658 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] default_volume_type            = ceph {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.003264 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_client_cert             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.003766 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_client_cert_key         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.004281 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_data_namespace          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.004725 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_ssl_cert_path           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.005080 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_ssl_cert_verify         = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.005455 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] driver_use_ssl                 = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.005842 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] enable_force_upload            = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.006150 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] enable_new_services            = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.006684 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] enable_unsupported_driver      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.007246 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] enabled_backends               = ['ceph'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.007752 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] enforce_multipath_for_image_xfer = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.008261 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] filter_function                = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.008769 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_api_insecure            = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.009331 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_api_servers             = ['http://10.222.0.33/image'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.009865 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_api_ssl_compression     = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.010209 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_ca_certificates_file    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.010621 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_catalog_info            = image:glance:publicURL {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.011012 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_certfile                = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.011531 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.011871 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_keyfile                 = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.012244 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_num_retries             = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.012717 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] glance_request_timeout         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.013070 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] goodness_function              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.013441 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] graceful_shutdown_timeout      = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.013802 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] group_api_class                = cinder.group.api.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.014089 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] host                           = ncdv-master-1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.014452 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iet_conf                       = /etc/iet/ietd.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.014920 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_compress_on_upload       = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.015296 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_conversion_address_space_limit = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.015807 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_conversion_cpu_limit     = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.016513 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_conversion_disable       = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_upload_use_cinder_backend = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_upload_use_internal_tenant = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_volume_cache_enabled     = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_volume_cache_max_count   = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] image_volume_cache_max_size_gb = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.211403 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] init_host_max_objects_retrieval = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] instance_format                = [instance: %(uuid)s]  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iscsi_iotype                   = fileio {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iscsi_secondary_ip_addresses   = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iscsi_target_flags             =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iscsi_write_cache              = on {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.214158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iser_helper                    = tgtadm {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215116 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iser_ip_address                = 10.222.0.33 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215116 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iser_port                      = 3260 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215116 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215346 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Starting volume driver RBDDriver (1.2.0)
Aug 06 20:44:51.215423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_config_append              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_dir                        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_file                       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_options                    = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215768 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.215858 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_rotate_interval            = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215858 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_rotate_interval_type       = days {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215858 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] log_rotation_type              = none {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215858 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.215858 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] max_age                        = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] max_logfile_count              = 30 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216456 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] max_logfile_size_mb            = 200 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] max_over_subscription_ratio    = 20.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] message_reap_interval          = 86400 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] message_ttl                    = 2592000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] migration_create_volume_timeout_secs = 300 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] monkey_patch                   = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] monkey_patch_modules           = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.216915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] my_ip                          = 10.222.0.33 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] no_snapshot_gb_quota           = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] num_iser_scan_tries            = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] num_shell_tries                = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] num_volume_device_scan_tries   = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] nvmet_ns_id                    = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] nvmet_port_id                  = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.217539 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_max_limit                = 1000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_ext_list          = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_listen_port       = 8776 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_use_ssl           = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218117 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] osapi_volume_workers           = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] per_volume_size_limit          = -1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] periodic_fuzzy_delay           = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] periodic_interval              = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] public_endpoint                = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] publish_errors                 = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.218668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_backup_gigabytes         = 1000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_backups                  = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_consistencygroups        = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_gigabytes                = 1000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_groups                   = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_snapshots                = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219129 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] quota_volumes                  = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] rate_limit_burst               = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] rate_limit_except_level        = CRITICAL {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] rate_limit_interval            = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] reinit_driver_count            = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] replication_device             = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] report_discard_supported       = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.219571 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] report_interval                = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] reservation_clean_interval     = 86400 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] reservation_expire             = 86400 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] reserved_percentage            = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220022 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] rpc_response_timeout           = 120 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] run_external_periodic_tasks    = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] scst_target_driver             = iscsi {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] scst_target_iqn_name           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_down_time              = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.220970 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] snapshot_name_template         = snapshot-%s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] snapshot_same_host             = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] split_loggers                  = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] state_path                     = /opt/stack/data/cinder {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] storage_availability_zone      = nova {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] storage_protocol               = iSCSI {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] syslog_log_facility            = LOG_USER {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.221619 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] target_helper                  = lioadm {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] target_ip_address              = 10.222.0.33 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] target_port                    = 3260 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] target_protocol                = iscsi {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] trace_flags                    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] transport_url                  = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] until_refresh                  = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_chap_auth                  = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_default_quota_class        = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_eventlog                   = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_journal                    = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222520 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_json                       = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_multipath_for_image_xfer   = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_stderr                     = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] use_syslog                     = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] verify_glance_signatures       = enabled {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_api_class               = cinder.volume.api.API {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_backend_name            = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.222984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_clear                   = zero {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_clear_ionice            = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_clear_size              = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_copy_bps_limit          = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_dd_blocksize            = 1M {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223423 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_name_template           = volume-%s {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_service_inithost_offload = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volume_usage_audit_period      = month {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] watch_log_file                 = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.223823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] zoning_mode                    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_concurrency.disable_process_locking = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224214 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.admin_password = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224580 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.admin_token = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.admin_user  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_admin_prefix =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_port   = 35357 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_protocol = https {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_section = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.224952 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_type   = password {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_uri    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.auth_version = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.cache       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.certfile    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225433 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.delay_auth_decision = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.http_connect_timeout = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.identity_uri = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.include_service_catalog = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.225823 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.insecure    = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.interface   = public {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.keyfile     = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226206 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.226737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.region_name = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.service_token_roles_required = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.service_type = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.token_cache_time = 300 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] keystone_authtoken.www_authenticate_uri = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.backend                  = dogpile.cache.null {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.backend_argument         = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.config_prefix            = cache.oslo {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.dead_timeout             = 60.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.debug_cache_backend      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.enable_retry_client      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.enable_socket_keepalive  = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.227983 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.enabled                  = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.expiration_time          = 600 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.hashclient_retry_attempts = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_dead_retry      = 300 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228538 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_pool_maxsize    = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.proxies                  = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.retry_attempts           = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.retry_delay              = 0.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.228991 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.socket_keepalive_count   = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.socket_keepalive_idle    = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.socket_keepalive_interval = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.tls_allowed_ciphers      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.tls_cafile               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.tls_certfile             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.tls_enabled              = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cache.tls_keyfile              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] coordination.backend_url       = etcd3+http://10.222.0.33:2379 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.backend               = sqlalchemy {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.connection            = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.connection_debug      = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.connection_parameters =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.connection_recycle_time = 3600 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.229929 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.connection_trace      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230364 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.db_inc_retry_interval = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.db_max_retries        = 20 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.db_max_retry_interval = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.db_retry_interval     = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.max_overflow          = 50 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.max_pool_size         = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230434 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.max_retries           = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.mysql_enable_ndb      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.pool_timeout          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.retry_interval        = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.slave_connection      = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.sqlite_synchronous    = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.230897 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] database.use_db_reconnect      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.enforce_new_defaults = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.enforce_scope      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.policy_default_rule = default {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.policy_file        = policy.yaml {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231342 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.connection_string     = messaging:// {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.231737 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.enabled               = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.es_doc_type           = notification {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.es_scroll_size        = 10000 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.es_scroll_time        = 2m {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.filter_error_trace    = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.hmac_keys             = SECRET_KEY {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.sentinel_service_name = mymaster {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232112 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.socket_timeout        = 0.1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] profiler.trace_sqlalchemy      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] os_brick.lock_path             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.capabilities   = [21] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.group          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.helper_command = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.logger_name    = oslo_privsep.daemon {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] privsep_osbrick.user           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.group         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.helper_command = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.232998 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] cinder_sys_admin.user          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.auth_section      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.auth_type         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.cafile            = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.certfile          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.collect_timing    = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.insecure          = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233537 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.keyfile           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.send_service_user_token = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.split_loggers     = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] service_user.timeout           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.backend_availability_zone = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.233980 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.chap_password = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.chap_username =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234360 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_client_cert = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_client_cert_key = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_data_namespace = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.driver_use_ssl = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.234770 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.enable_deferred_deletion = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.enable_unsupported_driver = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.extra_capabilities = {} {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.filter_function = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.goodness_function = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iet_conf      = /etc/iet/ietd.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.235642 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iscsi_iotype  = fileio {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iscsi_target_flags =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iscsi_write_cache = on {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iser_helper   = tgtadm {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iser_ip_address = 10.222.0.33 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236205 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iser_port     = 3260 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.num_shell_tries = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.236613 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.nvmet_port_id = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rados_connect_timeout = -1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rados_connection_interval = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rados_connection_retries = 3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_ceph_conf =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_cluster_name = ceph {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237001 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_pool      = rbd {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_secret_uuid = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.237709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.rbd_user      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.replication_connect_timeout = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.replication_device = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.report_discard_supported = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.reserved_percentage = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238081 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.scst_target_driver = iscsi {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.scst_target_iqn_name = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.storage_protocol = iSCSI {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.target_helper = tgtadm {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.target_ip_address = 10.222.0.33 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.238679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.target_port   = 3260 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239058 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239137 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.target_protocol = iscsi {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.trace_flags   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.unique_fqdn_network = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.use_chap_auth = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_backend_name = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239208 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_clear  = zero {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239773 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_clear_ionice = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239773 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_clear_size = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239773 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239773 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.239773 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.240100 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_reports.file_event_handler = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_reports.log_dir           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.backend_availability_zone = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.246567 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.backend_host              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.backend_native_threads_pool_size = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.backup_use_temp_snapshot  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.chap_password             = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.chap_username             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.chiscsi_conf              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.deferred_deletion_delay   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247028 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.deferred_deletion_purge_interval = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_client_cert        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_client_cert_key    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_data_namespace     = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_ssl_cert_path      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_ssl_cert_verify    = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.driver_use_ssl            = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247457 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.enable_deferred_deletion  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247945 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.enable_unsupported_driver = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.247945 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.extra_capabilities        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.filter_function           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.goodness_function         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iet_conf                  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.image_upload_use_cinder_backend = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.image_upload_use_internal_tenant = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.250566 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.image_volume_cache_enabled = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.251124 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.image_volume_cache_max_count = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.251124 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.image_volume_cache_max_size_gb = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.251331 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iscsi_iotype              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.252212 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.252812 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iscsi_target_flags        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.253248 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iscsi_write_cache         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.253600 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iser_helper               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.253946 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iser_ip_address           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.254293 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iser_port                 = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.254731 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.iser_target_prefix        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.255078 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.max_over_subscription_ratio = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.255411 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.num_iser_scan_tries       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.255761 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.num_shell_tries           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.256108 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.num_volume_device_scan_tries = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.256447 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.nvmet_ns_id               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.256785 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.nvmet_port_id             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.257182 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rados_connect_timeout     = -1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.257656 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rados_connection_interval = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.257943 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rados_connection_retries  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.258311 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_ceph_conf             = /etc/ceph/ceph.conf {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.258735 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_cluster_name          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.259119 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.259491 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.259989 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_max_clone_depth       = 5 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.260384 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_pool                  = volumes {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.260707 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_secret_uuid           = fa12a965-1599-4278-8ea2-aa161374e763 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.261068 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_store_chunk_size      = 4 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.261420 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.rbd_user                  = cinder {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.261766 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.replication_connect_timeout = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.262158 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.replication_device        = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.262680 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.report_discard_supported  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.262938 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.report_dynamic_total_capacity = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.263410 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.reserved_percentage       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.263760 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.scst_target_driver        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.264102 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.scst_target_iqn_name      = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.264475 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.storage_protocol          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.264892 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.suppress_requests_ssl_warnings = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.265142 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.target_helper             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.265483 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.target_ip_address         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.265832 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.target_port               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.266175 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.target_prefix             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.266570 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.target_protocol           = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.266955 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.trace_flags               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.267327 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.unique_fqdn_network       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.268361 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.use_chap_auth             = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.268915 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.use_multipath_for_image_xfer = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.269290 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_backend_name       = ceph {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.269639 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_clear              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.269984 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_clear_ionice       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.270327 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_clear_size         = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.270754 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.271105 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_copy_bps_limit     = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.271474 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_dd_blocksize       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.271842 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volume_driver             = cinder.volume.drivers.rbd.RBDDriver {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.272183 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ceph.volumes_dir               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.272639 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.273167 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.273542 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.273909 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.274279 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.274898 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.279087 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.279550 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.279942 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.280311 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.280725 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.281102 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.281507 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.281872 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.282237 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.282675 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.283076 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.283427 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.283806 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.284142 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.284495 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.284856 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.285215 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.285590 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.286111 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.286483 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl      = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.286885 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.287255 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.287608 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.287979 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.288357 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.288700 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_notifications.driver = [] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.289253 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_notifications.retry = -1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.289701 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.290237 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] oslo_messaging_notifications.transport_url = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.290618 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.291528 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] key_manager.fixed_key          = **** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.292191 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.292727 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.barbican_api_version  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.293709 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.barbican_endpoint     = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.294306 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.barbican_endpoint_type = public {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.294932 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.barbican_region_name  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.295330 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.cafile                = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.295668 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.certfile              = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.296608 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.collect_timing        = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.296971 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.insecure              = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.297320 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.keyfile               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.297854 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.number_of_retries     = 60 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.298219 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.retry_delay           = 1 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.298679 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.send_service_user_token = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.299029 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.split_loggers         = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.299534 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.timeout               = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.300063 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.verify_ssl            = True {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.300418 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican.verify_ssl_path       = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.300786 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.auth_section = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.301140 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.auth_type = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.301486 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.cafile   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.301844 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.certfile = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.302181 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.collect_timing = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.302528 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.insecure = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.302913 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.keyfile  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.303261 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.split_loggers = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.303601 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] barbican_service_user.timeout  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.303981 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.approle_role_id          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.304545 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.approle_secret_id        = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.305119 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.cafile                   = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.305746 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.certfile                 = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.306421 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.collect_timing           = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.307089 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.insecure                 = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.307636 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.keyfile                  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.308185 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.kv_mountpoint            = secret {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.308989 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.kv_version               = 2 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.309512 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.namespace                = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.310049 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.root_token_id            = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.310644 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.split_loggers            = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.311139 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.driver [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Driver hasn't implemented _init_vendor_properties()
Aug 06 20:44:51.311372 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.ssl_ca_crt_file          = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.311603 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.driver [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:15ef9320-ebbb-4160-936f-b48823c40af2:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135688) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Aug 06 20:44:51.312122 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.timeout                  = None {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.312676 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.use_ssl                  = False {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.313466 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}}
Aug 06 20:44:51.313946 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] ******************************************************************************** {{(pid=135515) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}}
Aug 06 20:44:51.328552 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_db.sqlalchemy.engines [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=135688) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 20:44:51.333685 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writer thread running {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 06 20:44:51.375280 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.db.sqlalchemy.api [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Building query based on filter {{(pid=135688) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Aug 06 20:44:51.405574 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=135688) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:991}}
Aug 06 20:44:51.416329 ncdv-master-1 cinder-volume[135688]: INFO cinder.keymgr.migration [None req-a27b97eb-6bbb-447f-acb0-61bde48f82aa None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 06 20:44:51.421196 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.454206 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.480128 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:44:51.509973 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Driver initialization completed successfully.
Aug 06 20:44:51.510702 ncdv-master-1 cinder-volume[135688]: INFO cinder.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Initiating service 3 cleanup
Aug 06 20:44:51.520428 ncdv-master-1 cinder-volume[135688]: INFO cinder.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Service 3 cleanup completed.
Aug 06 20:44:51.520758 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.service [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Creating RPC server for service cinder-volume {{(pid=135688) start /opt/stack/cinder/cinder/service.py:238}}
Aug 06 20:44:51.527482 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.service [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=135688) start /opt/stack/cinder/cinder/service.py:244}}
Aug 06 20:44:51.576146 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Aug 06 20:44:51.577210 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.605762 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:44:51.655147 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-daf31f64-81c1-4033-a7ac-5026655a8530 None None] Driver post RPC initialization completed successfully.
Aug 06 20:45:00.967927 ncdv-master-1 cinder-volume[135515]: DEBUG dbcounter [-] [135515] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=135515) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:45:01.648304 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=24,cinder:INSERT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:45:01.651753 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:45:41.657266 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:45:41.657866 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:46:01.661138 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:46:20.661589 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:46:20.662307 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:46:20.685094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:46:20.710470 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:46:21.671037 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:46:31.673634 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:47:01.678695 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:47:20.666477 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:47:20.667194 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:47:20.691522 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:47:20.715840 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:47:21.670126 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:47:41.679179 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:47:51.682982 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:48:11.696796 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:48:20.670180 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:48:20.670846 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:48:20.693896 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:48:20.715984 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:48:21.697683 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:48:31.703227 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:49:01.693641 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:49:11.697142 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:49:20.672820 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:49:20.673354 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:49:20.695228 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:49:20.718719 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:49:31.706173 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:49:51.707888 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:50:01.716900 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:50:20.674320 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:50:20.675007 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:50:20.697939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:50:20.720788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:50:21.719649 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:50:31.730060 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:50:51.729939 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:50:51.730581 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:51:11.738166 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:51:20.675571 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:51:20.676220 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:51:20.698537 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:51:20.721232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:51:21.746941 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:51:41.746942 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:51:51.755619 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:52:11.755780 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:52:11.756499 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:52:20.676712 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:52:20.677347 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:52:20.699721 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:52:20.721385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:52:21.765211 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:52:41.767392 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:52:51.773205 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:53:11.779054 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:53:20.677014 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:53:20.677650 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:53:20.700143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:53:20.725482 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:53:21.783268 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:53:41.790895 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:53:41.793152 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:54:01.806209 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:54:20.684589 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:54:20.686647 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:54:20.779872 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:54:20.853750 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:54:21.798210 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:54:41.799730 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:54:51.814896 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:55:11.819624 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:55:20.688809 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:55:20.689480 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:55:20.766315 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:55:20.902412 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:55:31.824858 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:55:51.813040 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:56:11.817122 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:56:20.689728 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:56:20.690518 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:56:20.769742 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:56:20.822792 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:56:21.814420 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:56:41.823168 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:56:41.833410 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:57:01.821229 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:57:01.828110 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:57:20.695333 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:57:20.697760 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:57:20.768282 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:57:20.834108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:57:29.237525 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:57:29.310049 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (76faec56-657f-427e-bdfb-9426d534a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:57:29.325523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a619c9-fa9c-4619-b8c1-b588a83fb76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.390069 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94a619c9-fa9c-4619-b8c1-b588a83fb76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-1481399918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea0b00ed-84e0-4e19-b008-139ee8117ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c99a4e2a24548ba906dd57b88cc0aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T20:57:29Z,use_quota=True,user_id='343f309c07e343b4b15268472d19f10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.395116 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d640960-8e0d-4531-91f1-c8dfb26ab509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.399045 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d640960-8e0d-4531-91f1-c8dfb26ab509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.403659 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554a6d7-ba41-4db3-9ac4-99ac68a17421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.409200 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554a6d7-ba41-4db3-9ac4-99ac68a17421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'volume_name': 'volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.417423 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef2c243-7868-44db-95b2-872a77242f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.423898 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef2c243-7868-44db-95b2-872a77242f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.428040 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1e6a3-5076-4c55-9244-1a39276b40bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.429303 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume ea0b00ed-84e0-4e19-b008-139ee8117ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'volume_size': 1}
Aug 06 20:57:29.429877 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] creating volume 'volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 20:57:29.430859 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:57:29.681571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:57:29.681945 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:57:29.685561 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e1e6a3-5076-4c55-9244-1a39276b40bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.692318 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207bcab4-9d18-4056-a8af-9935fb50ece3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:57:29.738478 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4 (ea0b00ed-84e0-4e19-b008-139ee8117ef4): created successfully
Aug 06 20:57:29.742016 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (207bcab4-9d18-4056-a8af-9935fb50ece3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:57:29.759512 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (76faec56-657f-427e-bdfb-9426d534a222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:57:29.779733 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5b0fb0d7-0170-42da-af44-3dfac51f7072 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created volume successfully.
Aug 06 20:57:32.094763 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:57:32.120326 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:57:32.139503 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-8747785f-f379-4585-92b8-6ccb45f2e21e req-2ed587ae-4012-40e3-89c5-96e559277cc1 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:57:33.007705 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-8747785f-f379-4585-92b8-6ccb45f2e21e req-2ed587ae-4012-40e3-89c5-96e559277cc1 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.868s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:57:33.009425 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-8747785f-f379-4585-92b8-6ccb45f2e21e req-2ed587ae-4012-40e3-89c5-96e559277cc1 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 20:57:33.127901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-8747785f-f379-4585-92b8-6ccb45f2e21e req-2ed587ae-4012-40e3-89c5-96e559277cc1 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Connection info returned from driver {'name': 'volumes/volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f2b755f0-3145-4a4c-b5c6-7df6dedf966e'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 20:57:33.250308 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-8747785f-f379-4585-92b8-6ccb45f2e21e req-2ed587ae-4012-40e3-89c5-96e559277cc1 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] attachment_update completed successfully.
Aug 06 20:57:41.872896 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-e270056a-bcda-4db6-89fe-3009f18273a9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:57:42.877397 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-e270056a-bcda-4db6-89fe-3009f18273a9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.004s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:57:42.878786 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-e270056a-bcda-4db6-89fe-3009f18273a9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 20:57:42.914121 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-e270056a-bcda-4db6-89fe-3009f18273a9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Connection info returned from driver {'name': 'volumes/volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea0b00ed-84e0-4e19-b008-139ee8117ef4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7941648e-f8fe-412d-9e8d-1ffb2a55e00c'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 20:57:42.991377 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-e270056a-bcda-4db6-89fe-3009f18273a9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] attachment_update completed successfully.
Aug 06 20:57:59.380524 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-174498ae-70a3-4205-bd83-4f36ff058717 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Terminate volume connection completed successfully.
Aug 06 20:57:59.388674 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-219c898e-1d43-48af-828f-caea2d8bbd3a req-174498ae-70a3-4205-bd83-4f36ff058717 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Deleting attachment f2b755f0-3145-4a4c-b5c6-7df6dedf966e. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 20:58:09.350875 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=27,cinder:UPDATE=5 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:58:09.352114 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=30,cinder:UPDATE=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:58:09.367478 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d745c1c4-98c1-4304-a295-fdd326d801fd req-d444a746-6447-452c-95d9-1d79ed2946c0 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Terminate volume connection completed successfully.
Aug 06 20:58:09.367928 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-d745c1c4-98c1-4304-a295-fdd326d801fd req-d444a746-6447-452c-95d9-1d79ed2946c0 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deleting attachment 7941648e-f8fe-412d-9e8d-1ffb2a55e00c. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 20:58:10.633630 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:58:10.657823 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (815ef0c2-b969-46f1-ae1b-d0ce3ee17b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:58:10.664187 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb48603-b12e-4aca-a38f-1f2c319a0336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:10.681015 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb48603-b12e-4aca-a38f-1f2c319a0336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-965093729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f7a7d268-fe92-4462-a9fe-5327fe7ad7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c99a4e2a24548ba906dd57b88cc0aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T20:58:11Z,use_quota=True,user_id='343f309c07e343b4b15268472d19f10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:10.687174 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7910260c-58aa-47c1-b901-71ff32954df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:10.691143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7910260c-58aa-47c1-b901-71ff32954df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:10.696035 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1225391-a12d-4084-bcf3-63bb33686949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:10.821227 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1225391-a12d-4084-bcf3-63bb33686949) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'volume_name': 'volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4759857e80>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:10.828006 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6437f0c-c567-4f5e-bc60-ad1d6c912c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:10.832386 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6437f0c-c567-4f5e-bc60-ad1d6c912c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:10.838768 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444b3a3d-67dc-4cc7-bbec-84401c891251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:10.840288 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume f7a7d268-fe92-4462-a9fe-5327fe7ad7f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4759857e80>}
Aug 06 20:58:10.841223 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Cloning f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 20:58:10.843983 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 20:58:10.860894 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 20:58:10.873986 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Preparing cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:889}}
Aug 06 20:58:10.875288 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 20:58:20.698784 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:58:20.701252 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:20.769285 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:20.841359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:58:21.863903 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:58:30.930417 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph, size 616.00 MB, duration 20.05 sec {{(pid=135688) fetch /opt/stack/cinder/cinder/image/image_utils.py:587}}
Aug 06 20:58:30.934840 ncdv-master-1 cinder-volume[135688]: INFO cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Image download 616.00 MB at 30.72 MB/s
Aug 06 20:58:31.069894 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:31.417093 ncdv-master-1 sudo[147577]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph
Aug 06 20:58:31.418632 ncdv-master-1 sudo[147577]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:34.827252 ncdv-master-1 sudo[147577]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:34.829992 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph" returned: 0 in 3.760s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:34.838697 ncdv-master-1 cinder-volume[135688]: WARNING py.warnings [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Aug 06 20:58:34.838697 ncdv-master-1 cinder-volume[135688]:   debtcollector.deprecate(
Aug 06 20:58:34.838697 ncdv-master-1 cinder-volume[135688]: 
Aug 06 20:58:34.840020 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Temporary image 5135514a-af3f-4057-893c-38dd4d85e4cd is fetched for user 343f309c07e343b4b15268472d19f10c. {{(pid=135688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1124}}
Aug 06 20:58:34.998716 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:35.212300 ncdv-master-1 sudo[147703]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph
Aug 06 20:58:35.216950 ncdv-master-1 sudo[147703]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:37.970169 ncdv-master-1 sudo[147703]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:37.973024 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph" returned: 0 in 2.974s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:37.974820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] creating volume 'volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 20:58:37.976025 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:38.181661 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:58:38.182106 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:58:38.231306 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Attempting download of 5135514a-af3f-4057-893c-38dd4d85e4cd ((None, None)) to volume f7a7d268-fe92-4462-a9fe-5327fe7ad7f5. {{(pid=135688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Aug 06 20:58:38.348373 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5135514a-af3f-4057-893c-38dd4d85e4cd_qyymw1g4 {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:38.734363 ncdv-master-1 sudo[147798]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5135514a-af3f-4057-893c-38dd4d85e4cd_qyymw1g4
Aug 06 20:58:38.736196 ncdv-master-1 sudo[147798]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:42.543716 ncdv-master-1 sudo[147798]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:42.546660 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_5135514a-af3f-4057-893c-38dd4d85e4cd_qyymw1g4" returned: 0 in 4.198s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:42.547917 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:42.933425 ncdv-master-1 sudo[147823]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph
Aug 06 20:58:42.934432 ncdv-master-1 sudo[147823]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:45.109114 ncdv-master-1 sudo[147823]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:45.111884 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph" returned: 0 in 2.564s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:45.116860 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] 5135514a-af3f-4057-893c-38dd4d85e4cd was vhdx, converting to raw {{(pid=135688) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:825}}
Aug 06 20:58:45.119500 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpvv2y7dok {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:45.150817 ncdv-master-1 sudo[147841]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpvv2y7dok
Aug 06 20:58:45.151824 ncdv-master-1 sudo[147841]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:48.222457 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:58:49.277288 ncdv-master-1 sudo[147841]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:49.279305 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmpvv2y7dok" returned: 0 in 4.160s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:49.280340 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:49.389628 ncdv-master-1 sudo[147885]:   ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph
Aug 06 20:58:49.395695 ncdv-master-1 sudo[147885]: pam_unix(sudo:session): session opened for user root by (uid=0)
Aug 06 20:58:51.342603 ncdv-master-1 sudo[147885]: pam_unix(sudo:session): session closed for user root
Aug 06 20:58:51.344784 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph" returned: 0 in 2.064s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:51.345514 ncdv-master-1 cinder-volume[135688]: WARNING py.warnings [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:71: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena'
Aug 06 20:58:51.345514 ncdv-master-1 cinder-volume[135688]:   debtcollector.deprecate(
Aug 06 20:58:51.345514 ncdv-master-1 cinder-volume[135688]: 
Aug 06 20:58:51.346228 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5135514a-af3f-4057-893c-38dd4d85e4cd_z8vmku6hncdv-master-1@ceph, size 700.00 MB, duration 4.16 sec, destination /opt/stack/data/cinder/conversion/tmpvv2y7dok {{(pid=135688) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:419}}
Aug 06 20:58:51.347249 ncdv-master-1 cinder-volume[135688]: INFO cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Converted 700.00 MB image at 168.20 MB/s
Aug 06 20:58:51.349885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:51.502833 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 20:58:51.509508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 20:58:51.539445 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] deleting rbd volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 20:58:51.852157 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:58:51.896010 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpvv2y7dok volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:58:58.143556 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmpvv2y7dok volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 6.247s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:58:58.328752 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:58.465571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:58:58.465571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:58:58.465571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Downloaded image 5135514a-af3f-4057-893c-38dd4d85e4cd ((None, None)) to volume f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 successfully. {{(pid=135688) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}}
Aug 06 20:58:58.606899 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Temporary image 5135514a-af3f-4057-893c-38dd4d85e4cd for user 343f309c07e343b4b15268472d19f10c is deleted. {{(pid=135688) fetch /opt/stack/cinder/cinder/image/image_utils.py:1128}}
Aug 06 20:58:58.732915 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 06 20:58:58.734076 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 06 20:58:58.867886 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created reservations ['92dd23ea-d108-44f6-8238-1aa46a0ad278', 'b7569c05-755a-4bd1-9b04-9992a779d15c', 'e9b2bbe0-fd4a-4c6a-acc6-c06855b8d8db', '0bf5851b-b863-43a3-bd8c-4969aa1bdb90'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 20:58:58.880964 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Creating image volume entry: {'provider_id': None, 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'provider_location': None, 'display_name': 'image-5135514a-af3f-4057-893c-38dd4d85e4cd', 'multiattach': False, 'project_id': '6c4962342201407a89793c5c9a6a6f36', 'size': 1, 'replication_status': None, 'scheduled_at': datetime.datetime(2022, 8, 6, 20, 58, 11, tzinfo=datetime.timezone.utc), 'host': 'ncdv-master-1@ceph#ceph', 'cluster_name': None, 'launched_at': None, 'volume_admin_metadata': [], 'provider_geometry': None, 'replication_driver_data': None, 'deleted_at': None, 'encryption_key_id': None, 'display_description': None, 'provider_auth': None, 'consistencygroup_id': None, 'metadata': {}, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'volume_metadata': [], 'created_at': datetime.datetime(2022, 8, 6, 20, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 58, 11, tzinfo=datetime.timezone.utc), 'shared_targets': True, 'deleted': False, 'terminated_at': None, 'service_uuid': None, 'group_id': None, 'ec2_id': None, 'availability_zone': 'nova', 'user_id': '343f309c07e343b4b15268472d19f10c', 'bootable': False, 'replication_extended_status': None, 'previous_status': None, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5'}. {{(pid=135688) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}}
Aug 06 20:58:59.008818 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume reschedule parameters: False retry: None {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:58:59.050737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (bed9d1ea-1f5d-42c7-a6eb-53cf90439d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:58:59.067964 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc5dd2-d479-4298-9e7c-ec05d46d24fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:59.099476 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4cc5dd2-d479-4298-9e7c-ec05d46d24fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='image-5135514a-af3f-4057-893c-38dd4d85e4cd',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6d97c949-ba9a-43cc-9a74-fa93d03d5db7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c4962342201407a89793c5c9a6a6f36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f7a7d268-fe92-4462-a9fe-5327fe7ad7f5,status='creating',terminated_at=None,updated_at=2022-08-06T20:58:11Z,use_quota=True,user_id='343f309c07e343b4b15268472d19f10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:59.112047 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516e837d-a754-42f2-a840-8655a85daf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:59.116152 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (516e837d-a754-42f2-a840-8655a85daf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:59.142381 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9257e355-2852-4f75-b48c-bae0a3de8d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:59.175384 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9257e355-2852-4f75-b48c-bae0a3de8d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'volume_name': 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'volume_size': 1, 'source_volid': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'source_volstatus': 'downloading'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:59.180412 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c9560f-2425-4718-aba9-83e434299096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:59.184842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c9560f-2425-4718-aba9-83e434299096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:58:59.203293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df97728-3204-471c-aecf-9d80ebed04e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:58:59.204404 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'volume_size': 1, 'source_volid': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'source_volstatus': 'downloading'}
Aug 06 20:58:59.238829 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:58:59.326453 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] creating snapshot='volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 20:59:00.328321 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] cloning 'volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5@volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7.clone_snap' to 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 20:59:00.502190 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 20:59:00.503725 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:59:00.504283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:59:00.550128 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 20:59:00.555273 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df97728-3204-471c-aecf-9d80ebed04e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'volume_size': 1, 'source_volid': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'source_volstatus': 'downloading'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:00.565552 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000f97f7-31be-4fd0-a09f-6ede84c56d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:00.587125 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7 (6d97c949-ba9a-43cc-9a74-fa93d03d5db7): created successfully
Aug 06 20:59:00.591361 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (000f97f7-31be-4fd0-a09f-6ede84c56d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:00.624891 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (bed9d1ea-1f5d-42c7-a6eb-53cf90439d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:00.651288 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created volume successfully.
Aug 06 20:59:00.711823 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Creating new image-volume cache entry for image 5135514a-af3f-4057-893c-38dd4d85e4cd on ncdv-master-1@ceph#ceph {{(pid=135688) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}}
Aug 06 20:59:00.724629 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] New image-volume cache entry created: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 20, 59, 0, 715393)}. {{(pid=135688) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}}
Aug 06 20:59:00.735692 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 49.874s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 20:59:00.737600 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Marking volume f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 20:59:00.760118 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to f7a7d268-fe92-4462-a9fe-5327fe7ad7f5. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 20:59:00.761283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Creating volume glance metadata for volume f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 20:59:00.895591 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (444b3a3d-67dc-4cc7-bbec-84401c891251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4759857e80>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:00.920543 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a6adc2-de29-4fc9-8910-840121e5a847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:00.939475 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 (f7a7d268-fe92-4462-a9fe-5327fe7ad7f5): created successfully
Aug 06 20:59:00.955490 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a6adc2-de29-4fc9-8910-840121e5a847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:00.998569 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Flow 'volume_create_manager' (815ef0c2-b969-46f1-ae1b-d0ce3ee17b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:01.033729 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e5462377-a728-44e8-a506-ea43b971e15e tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created volume successfully.
Aug 06 20:59:07.112695 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-377ac09d-ff0c-4776-9958-e037f944c6e4 req-275b2981-e8de-4a4a-ba04-5d6948f8924c tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:59:08.283402 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-377ac09d-ff0c-4776-9958-e037f944c6e4 req-275b2981-e8de-4a4a-ba04-5d6948f8924c tempest-LiveAutoBlockMigrationV225Test-1556093481 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.171s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:59:08.284358 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-377ac09d-ff0c-4776-9958-e037f944c6e4 req-275b2981-e8de-4a4a-ba04-5d6948f8924c tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 20:59:08.342345 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-377ac09d-ff0c-4776-9958-e037f944c6e4 req-275b2981-e8de-4a4a-ba04-5d6948f8924c tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Connection info returned from driver {'name': 'volumes/volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4338dd8d-4d40-4149-9cc7-4aa34a85a377'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 20:59:08.416094 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-377ac09d-ff0c-4776-9958-e037f944c6e4 req-275b2981-e8de-4a4a-ba04-5d6948f8924c tempest-LiveAutoBlockMigrationV225Test-1556093481 None] attachment_update completed successfully.
Aug 06 20:59:20.699082 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 20:59:20.700395 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:59:20.787579 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:59:20.902904 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 20:59:21.838367 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=44,cinder:UPDATE=14,cinder:INSERT=7,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:59:31.848603 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=58,cinder:UPDATE=12,cinder:INSERT=17,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:59:40.183339 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:59:40.256167 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (1ed5a7b8-086b-451d-b342-4ec48a6e588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:40.276081 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad8b9b1-5a17-4810-bda1-cf75c626c026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:40.342005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad8b9b1-5a17-4810-bda1-cf75c626c026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1681198000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2381464f-8d79-4e5e-8926-b919fcd72240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d35f36722e4fc8ac7d222cf93883e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T20:59:40Z,use_quota=True,user_id='dd9a63d793aa4a55822bfe108df664a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:40.363059 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f4ca05-42c9-482c-aca3-b8dbc123e057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:40.369180 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f4ca05-42c9-482c-aca3-b8dbc123e057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:40.392211 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86aa618-428f-424c-b97d-2fabc6ccc05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:40.627788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b86aa618-428f-424c-b97d-2fabc6ccc05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2381464f-8d79-4e5e-8926-b919fcd72240', 'volume_name': 'volume-2381464f-8d79-4e5e-8926-b919fcd72240', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0d1b20>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:40.645000 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea22498-15d4-46dd-b486-48381009f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:40.653849 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea22498-15d4-46dd-b486-48381009f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:40.662612 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c735f5f1-4571-490a-96a9-34161093e2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:40.664476 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume 2381464f-8d79-4e5e-8926-b919fcd72240: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2381464f-8d79-4e5e-8926-b919fcd72240', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0d1b20>}
Aug 06 20:59:40.665528 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Cloning 2381464f-8d79-4e5e-8926-b919fcd72240 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 20:59:40.666769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 20:59:40.690099 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.022s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 20:59:40.715683 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 20, 59, 40, 705777)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 20:59:40.716777 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 20:59:40.718390 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 20:59:40.727675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.038s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 20:59:40.729264 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 20:59:40.745464 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 20, 59, 40, 741354)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 20:59:40.747175 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 20:59:40.747870 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 20:59:40.791137 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:59:40.927711 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] creating snapshot='volume-2381464f-8d79-4e5e-8926-b919fcd72240.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 20:59:41.596400 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-2381464f-8d79-4e5e-8926-b919fcd72240.clone_snap' to 'volume-2381464f-8d79-4e5e-8926-b919fcd72240' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 20:59:41.780037 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 20:59:41.781502 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:59:41.781969 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:59:41.809100 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 20:59:41.810441 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Marking volume 2381464f-8d79-4e5e-8926-b919fcd72240 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 20:59:41.820875 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to 2381464f-8d79-4e5e-8926-b919fcd72240. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 20:59:41.821844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Creating volume glance metadata for volume 2381464f-8d79-4e5e-8926-b919fcd72240 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 20:59:41.947087 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c735f5f1-4571-490a-96a9-34161093e2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2381464f-8d79-4e5e-8926-b919fcd72240', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0d1b20>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:41.952123 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7c8bb-3da8-4426-8a95-c229ad9f8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:41.976212 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-2381464f-8d79-4e5e-8926-b919fcd72240 (2381464f-8d79-4e5e-8926-b919fcd72240): created successfully
Aug 06 20:59:41.983276 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f7c8bb-3da8-4426-8a95-c229ad9f8433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:42.002764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (1ed5a7b8-086b-451d-b342-4ec48a6e588a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:42.020364 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-23c04371-97ae-4849-abf3-b0a5ebc02e87 tempest-TaggedBootDevicesTest_v242-144839246 None] Created volume successfully.
Aug 06 20:59:42.900588 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:59:42.926897 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (c717b73c-aa46-4a52-a59a-dc29892c490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:42.936030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ced67-298f-44ad-882a-7eac7f6b1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:42.956347 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a2ced67-298f-44ad-882a-7eac7f6b1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1799079341',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4297f47d-31a4-4957-9809-e323b1575be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d35f36722e4fc8ac7d222cf93883e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T20:59:43Z,use_quota=True,user_id='dd9a63d793aa4a55822bfe108df664a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:42.963909 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2f5dc-3fcb-41aa-a298-22e1d7925837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:42.971234 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2f5dc-3fcb-41aa-a298-22e1d7925837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:42.980948 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536cbf5e-1ba9-4f9b-8c8c-fb6485dace27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:42.988103 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536cbf5e-1ba9-4f9b-8c8c-fb6485dace27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4297f47d-31a4-4957-9809-e323b1575be7', 'volume_name': 'volume-4297f47d-31a4-4957-9809-e323b1575be7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:42.998999 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c110feb4-0633-4c6b-ba54-c4e8864b0f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:43.003995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c110feb4-0633-4c6b-ba54-c4e8864b0f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:43.030674 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3119b17d-75e3-49d2-ab92-0163abb17586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:43.031855 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume 4297f47d-31a4-4957-9809-e323b1575be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4297f47d-31a4-4957-9809-e323b1575be7', 'volume_size': 1}
Aug 06 20:59:43.032283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] creating volume 'volume-4297f47d-31a4-4957-9809-e323b1575be7' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 20:59:43.033300 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:59:43.155101 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:59:43.155667 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:59:43.171699 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3119b17d-75e3-49d2-ab92-0163abb17586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4297f47d-31a4-4957-9809-e323b1575be7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:43.181454 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb661492-d374-479d-91af-ceb5535eb5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:43.200567 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-4297f47d-31a4-4957-9809-e323b1575be7 (4297f47d-31a4-4957-9809-e323b1575be7): created successfully
Aug 06 20:59:43.204582 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb661492-d374-479d-91af-ceb5535eb5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:43.215047 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (c717b73c-aa46-4a52-a59a-dc29892c490e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:43.228800 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-15a37107-d3c2-42fd-83fb-7ee586020ff0 tempest-TaggedBootDevicesTest_v242-144839246 None] Created volume successfully.
Aug 06 20:59:43.509708 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-83e7f758-1238-4159-81a5-2e84ea16eda9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 20:59:44.527740 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 20:59:44.556421 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (df673373-d8a8-4f07-802c-8b56a86afa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:44.565140 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cba84a-5c3e-444a-8421-5b5db5fe0ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.602076 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30cba84a-5c3e-444a-8421-5b5db5fe0ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T20:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1694901973',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2a66353-40fa-4672-99aa-9f8e137e1126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26d35f36722e4fc8ac7d222cf93883e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T20:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T20:59:44Z,use_quota=True,user_id='dd9a63d793aa4a55822bfe108df664a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.603402 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34be8ff9-371f-4652-ab32-79ecbb55b0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.608761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34be8ff9-371f-4652-ab32-79ecbb55b0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.615412 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66163680-b22c-4fdf-8c6f-ff055999c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.618985 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66163680-b22c-4fdf-8c6f-ff055999c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2a66353-40fa-4672-99aa-9f8e137e1126', 'volume_name': 'volume-a2a66353-40fa-4672-99aa-9f8e137e1126', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.625126 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b79aca5-2e89-4176-864c-bcd7081a5b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.630046 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b79aca5-2e89-4176-864c-bcd7081a5b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.635004 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c65232-53e2-47c3-9ed6-282492ac2a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.636169 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Volume a2a66353-40fa-4672-99aa-9f8e137e1126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2a66353-40fa-4672-99aa-9f8e137e1126', 'volume_size': 1}
Aug 06 20:59:44.637142 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] creating volume 'volume-a2a66353-40fa-4672-99aa-9f8e137e1126' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 20:59:44.638369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 20:59:44.775060 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 20:59:44.775487 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 20:59:44.781115 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35c65232-53e2-47c3-9ed6-282492ac2a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2a66353-40fa-4672-99aa-9f8e137e1126', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.792478 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a482c26-d40a-4020-9f02-135949505b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 20:59:44.823527 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-a2a66353-40fa-4672-99aa-9f8e137e1126 (a2a66353-40fa-4672-99aa-9f8e137e1126): created successfully
Aug 06 20:59:44.831570 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a482c26-d40a-4020-9f02-135949505b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 20:59:44.861259 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Flow 'volume_create_manager' (df673373-d8a8-4f07-802c-8b56a86afa0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 20:59:44.874335 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ba881760-542d-404d-9c21-d692c5aff6ed tempest-TaggedBootDevicesTest_v242-144839246 None] Created volume successfully.
Aug 06 20:59:44.983815 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-83e7f758-1238-4159-81a5-2e84ea16eda9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.475s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 20:59:44.985255 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-83e7f758-1238-4159-81a5-2e84ea16eda9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 20:59:45.019912 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-83e7f758-1238-4159-81a5-2e84ea16eda9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Connection info returned from driver {'name': 'volumes/volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f7a7d268-fe92-4462-a9fe-5327fe7ad7f5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '92e52187-85fc-493d-ad22-b475a1cbb9ad'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 20:59:45.089695 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-83e7f758-1238-4159-81a5-2e84ea16eda9 tempest-LiveAutoBlockMigrationV225Test-554212102 None] attachment_update completed successfully.
Aug 06 20:59:55.105305 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=50,cinder:UPDATE=9,cinder:INSERT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 20:59:55.122917 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-4ad2098e-d91c-4c3c-97b4-6b2a350ab512 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Terminate volume connection completed successfully.
Aug 06 20:59:55.123748 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-74d4d518-1341-468b-a400-f2664e4aeb29 req-4ad2098e-d91c-4c3c-97b4-6b2a350ab512 tempest-LiveAutoBlockMigrationV225Test-554212102 None] Deleting attachment 4338dd8d-4d40-4149-9cc7-4aa34a85a377. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:00:11.859407 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=33,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:00:20.649423 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-78a63235-fc2f-414a-b6ee-a3e67f69d43b tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Terminate volume connection completed successfully.
Aug 06 21:00:20.650535 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-78a63235-fc2f-414a-b6ee-a3e67f69d43b tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deleting attachment 92e52187-85fc-493d-ad22-b475a1cbb9ad. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:00:20.699697 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:00:20.700940 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:20.833554 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:20.978108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:00:21.077756 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Acquiring lock "cinder-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:00:21.132766 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:00:21.284828 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:21.478207 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:00:21.480042 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] volume has clone snapshot(s) {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1288}}
Aug 06 21:00:21.485520 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:00:21.737161 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created reservations ['45ffe81b-e191-42e8-95d4-a53907abcbdb', 'bf88f097-57de-497a-be90-2f28c393f460', '3d8afaa3-b4ad-4c39-b848-537bb9748716', '1b7c6b14-b838-47e8-92c6-7d2804ff993f'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:00:21.825948 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:21.946582 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:22.036342 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:00:22.049667 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deleted volume successfully.
Aug 06 21:00:22.089315 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-c7316ef9-a83c-46e5-9fd7-8611619a92d3 req-37cbb493-4299-41d2-bf31-763d03c3ab70 tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5-delete_volume" released by "delete_volume" :: held 0.954s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:00:22.151621 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Acquiring lock "cinder-ea0b00ed-84e0-4e19-b008-139ee8117ef4-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:00:22.172228 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-ea0b00ed-84e0-4e19-b008-139ee8117ef4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:00:22.311903 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:22.423809 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:00:22.424725 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Volume volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:00:22.439074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] deleting rbd volume volume-ea0b00ed-84e0-4e19-b008-139ee8117ef4 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:00:22.917885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Created reservations ['6b1e87d6-a679-4a28-9041-ba4249307c2a', '5de30bfa-3b5c-4d8f-b672-cea98fb58241', '4b904bad-92fa-411e-81b5-a1065f01d6cb', '3a28b0d5-c766-4a19-a7a2-f2e9b162ac78'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:00:23.026956 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:23.147717 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:00:23.257291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:00:23.281113 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Deleted volume successfully.
Aug 06 21:00:23.345258 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6f79c464-88f3-49ea-bbf8-f80dc8e665ad tempest-LiveAutoBlockMigrationV225Test-1556093481 None] Lock "cinder-ea0b00ed-84e0-4e19-b008-139ee8117ef4-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:00:32.044476 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=34,cinder:UPDATE=21,cinder:INSERT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:00:42.036387 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=29,cinder:UPDATE=15,cinder:INSERT=7,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:00:42.876964 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-42f867f3-516a-4c5a-90b2-8bd2e27ff79a tempest-TaggedBootDevicesTest_v242-144839246 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:00:45.459282 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-42f867f3-516a-4c5a-90b2-8bd2e27ff79a tempest-TaggedBootDevicesTest_v242-144839246 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.582s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:00:45.460805 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-42f867f3-516a-4c5a-90b2-8bd2e27ff79a tempest-TaggedBootDevicesTest_v242-144839246 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2381464f-8d79-4e5e-8926-b919fcd72240', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '2381464f-8d79-4e5e-8926-b919fcd72240', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:00:45.545517 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-42f867f3-516a-4c5a-90b2-8bd2e27ff79a tempest-TaggedBootDevicesTest_v242-144839246 None] Connection info returned from driver {'name': 'volumes/volume-2381464f-8d79-4e5e-8926-b919fcd72240', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2381464f-8d79-4e5e-8926-b919fcd72240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5a9d3fc6-7297-437d-90d5-8c4e7edf909a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:00:45.683720 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-42f867f3-516a-4c5a-90b2-8bd2e27ff79a tempest-TaggedBootDevicesTest_v242-144839246 None] attachment_update completed successfully.
Aug 06 21:00:46.250584 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-99f43030-eaab-4914-9c71-9d22aaa3577b tempest-TaggedBootDevicesTest_v242-144839246 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:00:48.421956 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-99f43030-eaab-4914-9c71-9d22aaa3577b tempest-TaggedBootDevicesTest_v242-144839246 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.171s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:00:48.422831 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-99f43030-eaab-4914-9c71-9d22aaa3577b tempest-TaggedBootDevicesTest_v242-144839246 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4297f47d-31a4-4957-9809-e323b1575be7', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '4297f47d-31a4-4957-9809-e323b1575be7', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:00:48.469793 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-99f43030-eaab-4914-9c71-9d22aaa3577b tempest-TaggedBootDevicesTest_v242-144839246 None] Connection info returned from driver {'name': 'volumes/volume-4297f47d-31a4-4957-9809-e323b1575be7', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4297f47d-31a4-4957-9809-e323b1575be7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '48dd9ae8-1d7b-45fb-81b4-e8fecd81fa7c'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:00:48.588918 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-99f43030-eaab-4914-9c71-9d22aaa3577b tempest-TaggedBootDevicesTest_v242-144839246 None] attachment_update completed successfully.
Aug 06 21:00:49.179100 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-96b3d403-ac6d-417e-b66f-2168785e52f1 tempest-TaggedBootDevicesTest_v242-144839246 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:00:51.448311 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-96b3d403-ac6d-417e-b66f-2168785e52f1 tempest-TaggedBootDevicesTest_v242-144839246 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 2.269s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:00:51.449129 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-96b3d403-ac6d-417e-b66f-2168785e52f1 tempest-TaggedBootDevicesTest_v242-144839246 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a2a66353-40fa-4672-99aa-9f8e137e1126', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'a2a66353-40fa-4672-99aa-9f8e137e1126', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:00:51.506131 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-96b3d403-ac6d-417e-b66f-2168785e52f1 tempest-TaggedBootDevicesTest_v242-144839246 None] Connection info returned from driver {'name': 'volumes/volume-a2a66353-40fa-4672-99aa-9f8e137e1126', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a2a66353-40fa-4672-99aa-9f8e137e1126', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e791e2d2-a163-4469-9c8e-dc662ba87e4c'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:00:51.765504 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-07231c04-8b27-42a7-b0d8-4ac1e6c52d85 req-96b3d403-ac6d-417e-b66f-2168785e52f1 tempest-TaggedBootDevicesTest_v242-144839246 None] attachment_update completed successfully.
Aug 06 21:01:01.765853 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=29,cinder:UPDATE=5 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:01:12.039190 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=42,cinder:UPDATE=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:01:20.694818 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:01:20.695698 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:01:20.802722 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:01:20.877501 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:01:32.036527 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:01:42.057358 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:01:48.144076 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:01:48.179719 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Flow 'volume_create_manager' (c45fdfd9-48a1-4fa9-bf60-d6987c6e8932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:01:48.187938 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c601cc9-585c-4491-bafa-3b19264c7b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.206360 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c601cc9-585c-4491-bafa-3b19264c7b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-607285386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc36f344d274f89b5139ba88bef375b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:01:48Z,use_quota=True,user_id='145439e0e0d549f89b17e81cbd46c580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.212875 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f49ed9-931e-4b47-a95b-2c96c68817d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.225957 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f49ed9-931e-4b47-a95b-2c96c68817d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.235979 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c5ed2f-4ce2-4df3-90cb-f9fd642cf021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.240517 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95c5ed2f-4ce2-4df3-90cb-f9fd642cf021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'volume_name': 'volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.246337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc6cb6-590e-4702-8b43-50013ba250e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.250255 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cc6cb6-590e-4702-8b43-50013ba250e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.277793 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e98df-64e2-43e3-826b-62ed6dff6f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.279525 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Volume 6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'volume_size': 1}
Aug 06 21:01:48.280132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] creating volume 'volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:01:48.280780 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:01:48.432072 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:01:48.432592 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:01:48.436837 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (066e98df-64e2-43e3-826b-62ed6dff6f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.442273 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a5d1f-5d85-42bf-b769-d5dd6bda3ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:01:48.453557 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Volume volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada (6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada): created successfully
Aug 06 21:01:48.458580 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd5a5d1f-5d85-42bf-b769-d5dd6bda3ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:01:48.464520 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Flow 'volume_create_manager' (c45fdfd9-48a1-4fa9-bf60-d6987c6e8932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:01:48.476814 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ee185d0f-a181-4aa1-a1c8-86488e45dfa1 tempest-VolumesAdminNegativeTest-1941017306 None] Created volume successfully.
Aug 06 21:01:49.993818 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 req-061fd643-abba-451e-9c1e-3973fc845f75 tempest-VolumesAdminNegativeTest-1941017306 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:01:51.421106 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 req-061fd643-abba-451e-9c1e-3973fc845f75 tempest-VolumesAdminNegativeTest-1941017306 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.427s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:01:51.423236 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 req-061fd643-abba-451e-9c1e-3973fc845f75 tempest-VolumesAdminNegativeTest-1941017306 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:01:51.479289 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 req-061fd643-abba-451e-9c1e-3973fc845f75 tempest-VolumesAdminNegativeTest-1941017306 None] Connection info returned from driver {'name': 'volumes/volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '78a16bdd-58d8-481e-8dc3-62848557ce1b'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:01:51.631409 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d9fcd0c5-f592-439b-bdf3-588f2a187ac5 req-061fd643-abba-451e-9c1e-3973fc845f75 tempest-VolumesAdminNegativeTest-1941017306 None] attachment_update completed successfully.
Aug 06 21:01:55.228174 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 req-98e3513d-c578-480c-a7f2-9846db821872 tempest-VolumesAdminNegativeTest-1941017306 None] Terminate volume connection completed successfully.
Aug 06 21:01:55.229568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-42da14e3-a0d6-4362-8d7b-380b85bb50f7 req-98e3513d-c578-480c-a7f2-9846db821872 tempest-VolumesAdminNegativeTest-1941017306 None] Deleting attachment 78a16bdd-58d8-481e-8dc3-62848557ce1b. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:02:02.049038 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=22,cinder:UPDATE=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:02:05.119421 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:05.176470 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Flow 'volume_create_manager' (3dc0e0bb-2ebc-4579-9b5c-4298e27e9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:05.193083 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b083faaf-9214-4b3f-a41d-5016b0e86a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.285639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b083faaf-9214-4b3f-a41d-5016b0e86a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1118101861',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2032c09-f692-47ea-8efd-c110c7f3d7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='155b2c35804a4799a75a327703a5e26e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:05Z,use_quota=True,user_id='d5754e7eed1b48f8805b6dffefb37b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.286122 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e89cf-2e7e-480c-8128-892a378a45d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.286122 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8e89cf-2e7e-480c-8128-892a378a45d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.295591 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9811f8ab-5272-4573-a159-4a37385a67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.303908 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9811f8ab-5272-4573-a159-4a37385a67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2032c09-f692-47ea-8efd-c110c7f3d7de', 'volume_name': 'volume-e2032c09-f692-47ea-8efd-c110c7f3d7de', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.308659 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47f3b59-988f-4735-bb4c-ab8c8eb63e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.314027 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47f3b59-988f-4735-bb4c-ab8c8eb63e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.319032 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5d1fb9-5ea0-4ed5-ae14-bc010f71dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.321019 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Volume e2032c09-f692-47ea-8efd-c110c7f3d7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2032c09-f692-47ea-8efd-c110c7f3d7de', 'volume_size': 1}
Aug 06 21:02:05.321436 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] creating volume 'volume-e2032c09-f692-47ea-8efd-c110c7f3d7de' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:02:05.322202 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:05.461862 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:05.462763 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:05.469260 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5d1fb9-5ea0-4ed5-ae14-bc010f71dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2032c09-f692-47ea-8efd-c110c7f3d7de', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.475292 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a58cd35-44a9-4b73-9c00-d1e5f0898a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:05.500023 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Volume volume-e2032c09-f692-47ea-8efd-c110c7f3d7de (e2032c09-f692-47ea-8efd-c110c7f3d7de): created successfully
Aug 06 21:02:05.508489 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a58cd35-44a9-4b73-9c00-d1e5f0898a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:05.527018 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Flow 'volume_create_manager' (3dc0e0bb-2ebc-4579-9b5c-4298e27e9866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:05.565096 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-6e414c58-5547-42c9-8f3f-1e1ad21f0d0f tempest-AttachSCSIVolumeTestJSON-1978267485 None] Created volume successfully.
Aug 06 21:02:07.213103 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f req-23666bee-2364-4f5e-a8cf-28d61215f58d tempest-AttachSCSIVolumeTestJSON-1978267485 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:02:08.397385 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f req-23666bee-2364-4f5e-a8cf-28d61215f58d tempest-AttachSCSIVolumeTestJSON-1978267485 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.184s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:02:08.398365 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f req-23666bee-2364-4f5e-a8cf-28d61215f58d tempest-AttachSCSIVolumeTestJSON-1978267485 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2032c09-f692-47ea-8efd-c110c7f3d7de', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'e2032c09-f692-47ea-8efd-c110c7f3d7de', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:02:08.433675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f req-23666bee-2364-4f5e-a8cf-28d61215f58d tempest-AttachSCSIVolumeTestJSON-1978267485 None] Connection info returned from driver {'name': 'volumes/volume-e2032c09-f692-47ea-8efd-c110c7f3d7de', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2032c09-f692-47ea-8efd-c110c7f3d7de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9330e30f-2193-4029-abd4-29e067411adc'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:02:08.506245 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-a8fa80d8-0b8d-4de7-a20a-857bf6e93c9f req-23666bee-2364-4f5e-a8cf-28d61215f58d tempest-AttachSCSIVolumeTestJSON-1978267485 None] attachment_update completed successfully.
Aug 06 21:02:13.971687 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=36,cinder:UPDATE=9,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:02:13.986187 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:14.009675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Flow 'volume_create_manager' (ac9e0fe4-12c8-4d19-b9fd-8f243111e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:14.020221 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c566e91-aece-4de2-b211-6dd404aa7c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.050605 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c566e91-aece-4de2-b211-6dd404aa7c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-366581283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=cc54a2c0-3b44-406c-9e10-b221f92a2c83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afc36f344d274f89b5139ba88bef375b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:14Z,use_quota=True,user_id='145439e0e0d549f89b17e81cbd46c580',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.059302 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d13d7-bee4-4c48-9509-0fe88272224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.065402 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba4d13d7-bee4-4c48-9509-0fe88272224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.071954 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac22449-2669-42d9-bafc-d447399e6363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.077062 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac22449-2669-42d9-bafc-d447399e6363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc54a2c0-3b44-406c-9e10-b221f92a2c83', 'volume_name': 'volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.082603 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e2457-a2de-4154-85fb-64772697e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.102867 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e2457-a2de-4154-85fb-64772697e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.118057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3acd7ff-f818-4fe4-818c-d0aab9432655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.119629 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Volume cc54a2c0-3b44-406c-9e10-b221f92a2c83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83', 'volume_size': 1}
Aug 06 21:02:14.126468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] creating volume 'volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:02:14.127324 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:14.235856 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb req-6c06bedc-252c-4c8f-8c98-d52381c4ed3a tempest-AttachSCSIVolumeTestJSON-1978267485 None] Terminate volume connection completed successfully.
Aug 06 21:02:14.237024 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-8f1c91e4-7a8c-45f0-b9b3-fff92d0bafeb req-6c06bedc-252c-4c8f-8c98-d52381c4ed3a tempest-AttachSCSIVolumeTestJSON-1978267485 None] Deleting attachment 9330e30f-2193-4029-abd4-29e067411adc. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:02:14.284088 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:14.284726 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:14.288820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3acd7ff-f818-4fe4-818c-d0aab9432655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.298786 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebd883-df8d-49b1-b34e-bba1a9f6fb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:14.322532 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Volume volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83 (cc54a2c0-3b44-406c-9e10-b221f92a2c83): created successfully
Aug 06 21:02:14.332232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ebd883-df8d-49b1-b34e-bba1a9f6fb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:14.355352 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Flow 'volume_create_manager' (ac9e0fe4-12c8-4d19-b9fd-8f243111e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:14.368328 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c83a723e-d770-40ee-9c56-3b15d2f8254d tempest-VolumesAdminNegativeTest-1941017306 None] Created volume successfully.
Aug 06 21:02:15.257516 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Acquiring lock "cinder-cc54a2c0-3b44-406c-9e10-b221f92a2c83-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:02:15.278830 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Lock "cinder-cc54a2c0-3b44-406c-9e10-b221f92a2c83-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:02:15.332424 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:15.404890 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:02:15.405820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Volume volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:02:15.416690 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] deleting rbd volume volume-cc54a2c0-3b44-406c-9e10-b221f92a2c83 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:02:15.751741 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Created reservations ['bbaf0aa7-d5a4-4a14-ad2d-28e40dfb22de', 'd30c415b-98d3-46d5-88d0-7733e6bceed1', 'dbdb93c0-f768-4191-abad-c819d37bf1d0', 'e3346e36-bedb-4942-95ac-048fdbefd01a'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:02:15.860095 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:15.918112 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:15.982054 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:02:15.987463 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Deleted volume successfully.
Aug 06 21:02:16.016692 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb03fd53-8fbd-4c41-9709-49167f317080 tempest-VolumesAdminNegativeTest-1941017306 None] Lock "cinder-cc54a2c0-3b44-406c-9e10-b221f92a2c83-delete_volume" released by "delete_volume" :: held 0.738s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:02:20.694243 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:02:20.695017 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:20.775082 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:20.889471 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:02:22.472664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Acquiring lock "cinder-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:02:22.491864 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Lock "cinder-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:02:22.590859 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:22.748062 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:02:22.748789 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Volume volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:02:22.758887 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] deleting rbd volume volume-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:02:23.109684 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Created reservations ['f963c2a7-bd18-4183-96e3-2d5c03eceac6', '9119a4fe-2a56-433c-b936-556ebfd53cfd', 'd5be222f-addd-4335-9519-2e326d66c9d6', '1905f755-6ca6-4ffe-8910-c37bea893865'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:02:23.197168 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:23.266374 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:23.360886 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:02:23.387749 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Deleted volume successfully.
Aug 06 21:02:23.442291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-cb1f2547-38ec-420b-bed5-e256c6b70d0b tempest-VolumesAdminNegativeTest-1941017306 None] Lock "cinder-6df5b5a1-c6c1-43bc-9ad9-760cf1ab5ada-delete_volume" released by "delete_volume" :: held 0.952s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:02:26.808326 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Acquiring lock "cinder-e2032c09-f692-47ea-8efd-c110c7f3d7de-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:02:26.839501 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Lock "cinder-e2032c09-f692-47ea-8efd-c110c7f3d7de-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:02:26.999782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:27.133583 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:02:27.135658 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Volume volume-e2032c09-f692-47ea-8efd-c110c7f3d7de is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:02:27.166901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] deleting rbd volume volume-e2032c09-f692-47ea-8efd-c110c7f3d7de {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:02:27.608438 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Created reservations ['2802c2a0-7408-4336-a4a3-0b76fbcaf03a', '5241f7c0-0e61-42af-a0e9-5ca3c2a490de', '484680b5-afe2-4f45-86eb-36f7044571bd', '01603ae6-5327-417b-b3cd-3d3782941a72'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:02:27.692700 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:27.748013 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:27.817165 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:02:27.828222 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Deleted volume successfully.
Aug 06 21:02:27.849529 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d2f7bcb-6561-460b-ae35-49096d7935c9 tempest-AttachSCSIVolumeTestJSON-1978267485 None] Lock "cinder-e2032c09-f692-47ea-8efd-c110c7f3d7de-delete_volume" released by "delete_volume" :: held 1.010s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:02:32.141232 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=58,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:02:52.067244 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=52,cinder:UPDATE=25,cinder:INSERT=11,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:02:52.421888 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:52.483293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (e9942e6a-525f-4222-9922-9136ae2a91c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:52.498868 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc32b26-dcc3-4057-b011-8532e93b0f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:52.571737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc32b26-dcc3-4057-b011-8532e93b0f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1126017217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c50e947-04ab-4f1c-af43-9bdf85fe71c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed29bedd5e4f4788958bad354166f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:52Z,use_quota=True,user_id='78f7a58ae0b24b6a9aca96713dfe99b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:52.585434 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2771a3-f472-4c9f-9713-b8d974e55a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:52.589677 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c2771a3-f472-4c9f-9713-b8d974e55a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:52.608665 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8004422a-73ab-402c-a275-547d9936438c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:52.775279 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8004422a-73ab-402c-a275-547d9936438c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'volume_name': 'volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0f47c0>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:52.787523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba2c35-e711-4886-a832-b6df00b71457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:52.791457 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ba2c35-e711-4886-a832-b6df00b71457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:52.837048 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e482d3a-69bd-4b65-b115-f2b56666dd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:52.838202 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Volume 1c50e947-04ab-4f1c-af43-9bdf85fe71c4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0f47c0>}
Aug 06 21:02:52.838808 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Cloning 1c50e947-04ab-4f1c-af43-9bdf85fe71c4 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:02:52.839539 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:02:52.868843 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.029s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:02:52.900243 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 2, 52, 881390)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:02:52.902330 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:02:52.903705 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:02:52.912058 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.043s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:02:52.913594 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:02:52.927307 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 2, 52, 917796)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:02:52.929162 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:02:52.930567 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:02:52.962762 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:53.078256 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] creating snapshot='volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:02:53.881264 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4.clone_snap' to 'volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:02:53.960131 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:54.045130 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Flow 'volume_create_manager' (baa161b8-bb59-4e58-aff2-06c86ff6f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:54.053168 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ae6f12-e171-4de8-bb93-bff504f66783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.125680 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:02:54.129468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:54.130325 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:54.179079 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:02:54.180596 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Marking volume 1c50e947-04ab-4f1c-af43-9bdf85fe71c4 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:02:54.219817 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2ae6f12-e171-4de8-bb93-bff504f66783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-982865240',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=aa673255-11d9-4633-b5e3-fd8bc6522a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47f439135a6445fa29c8be6d69c1759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:53Z,use_quota=True,user_id='ad1a96004778407584d1805b07ad1c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.227399 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac2b975-8847-4893-82d0-3b0ba1b15d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.253469 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac2b975-8847-4893-82d0-3b0ba1b15d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.271939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3445fca-9b6f-43e2-80d1-c3e05f65952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.287784 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3445fca-9b6f-43e2-80d1-c3e05f65952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa673255-11d9-4633-b5e3-fd8bc6522a18', 'volume_name': 'volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.313841 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86884fe1-b661-46da-95c7-8cb61260bcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.327571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86884fe1-b661-46da-95c7-8cb61260bcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.334508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea78a7be-e672-47dc-8724-a52f7baaf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.344543 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Volume aa673255-11d9-4633-b5e3-fd8bc6522a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'volume_size': 1}
Aug 06 21:02:54.357097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] creating volume 'volume-aa673255-11d9-4633-b5e3-fd8bc6522a18' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:02:54.358579 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:54.414932 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to 1c50e947-04ab-4f1c-af43-9bdf85fe71c4. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:02:54.415885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Creating volume glance metadata for volume 1c50e947-04ab-4f1c-af43-9bdf85fe71c4 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:02:54.564457 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:54.565558 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:54.572923 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea78a7be-e672-47dc-8724-a52f7baaf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.579500 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e3cfdb-55ae-4dc2-9793-0085eeecb25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.591870 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e482d3a-69bd-4b65-b115-f2b56666dd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a0f47c0>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.597715 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abb3d09-7c4f-4d21-b01b-6c57a64b0176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:54.610193 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Volume volume-aa673255-11d9-4633-b5e3-fd8bc6522a18 (aa673255-11d9-4633-b5e3-fd8bc6522a18): created successfully
Aug 06 21:02:54.616404 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e3cfdb-55ae-4dc2-9793-0085eeecb25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.636137 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Flow 'volume_create_manager' (baa161b8-bb59-4e58-aff2-06c86ff6f15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:54.644351 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Volume volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4 (1c50e947-04ab-4f1c-af43-9bdf85fe71c4): created successfully
Aug 06 21:02:54.650509 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abb3d09-7c4f-4d21-b01b-6c57a64b0176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:54.658233 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (e9942e6a-525f-4222-9922-9136ae2a91c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:54.683844 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e49136f9-99b3-482f-852f-228db826d2f1 tempest-LiveMigrationTest-875310508 None] Created volume successfully.
Aug 06 21:02:54.690906 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c06442d4-1644-45a4-8daf-81f158905871 tempest-TaggedBootDevicesTest-335631018 None] Created volume successfully.
Aug 06 21:02:56.173149 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-16790848-8bcf-47f7-95ea-4c0491214af2 req-c2a44185-61f3-451f-856a-5e961db44295 tempest-LiveMigrationTest-875310508 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:02:56.506497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:56.560364 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (f2b34b16-79c4-4de6-a646-45a7de184d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:56.583306 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeaa15b-af67-4f50-ba7a-67805b0e4c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.631380 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfeaa15b-af67-4f50-ba7a-67805b0e4c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-279753589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed29bedd5e4f4788958bad354166f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:56Z,use_quota=True,user_id='78f7a58ae0b24b6a9aca96713dfe99b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.636887 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ffed6e-9dab-436c-b357-4e4bdf7263dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.642165 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07ffed6e-9dab-436c-b357-4e4bdf7263dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.659889 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d140b7-6fc6-4e47-9466-0346bc1b20a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.670836 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d140b7-6fc6-4e47-9466-0346bc1b20a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'volume_name': 'volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.692120 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a8888-e062-4d88-80e4-a22d7a87dccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.701556 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f16a8888-e062-4d88-80e4-a22d7a87dccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.708804 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c18d1f2-a0d8-4748-9109-0b27e93f61d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.714944 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Volume 4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'volume_size': 1}
Aug 06 21:02:56.717475 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] creating volume 'volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:02:56.718615 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:56.879639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:56.880403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:56.901701 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c18d1f2-a0d8-4748-9109-0b27e93f61d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.918277 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc1bec8-972c-463d-9465-b6cb999501a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:56.955214 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Volume volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5 (4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5): created successfully
Aug 06 21:02:56.959198 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddc1bec8-972c-463d-9465-b6cb999501a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:56.971821 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (f2b34b16-79c4-4de6-a646-45a7de184d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:56.992591 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f98d724a-1355-4089-ad90-1e61af534962 tempest-TaggedBootDevicesTest-335631018 None] Created volume successfully.
Aug 06 21:02:57.508963 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-16790848-8bcf-47f7-95ea-4c0491214af2 req-c2a44185-61f3-451f-856a-5e961db44295 tempest-LiveMigrationTest-875310508 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.336s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:02:57.514323 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-16790848-8bcf-47f7-95ea-4c0491214af2 req-c2a44185-61f3-451f-856a-5e961db44295 tempest-LiveMigrationTest-875310508 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'aa673255-11d9-4633-b5e3-fd8bc6522a18', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:02:57.551632 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-16790848-8bcf-47f7-95ea-4c0491214af2 req-c2a44185-61f3-451f-856a-5e961db44295 tempest-LiveMigrationTest-875310508 None] Connection info returned from driver {'name': 'volumes/volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa673255-11d9-4633-b5e3-fd8bc6522a18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e602ffdb-411b-4cd3-a770-5bbe7c0b33f5'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:02:57.617256 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-16790848-8bcf-47f7-95ea-4c0491214af2 req-c2a44185-61f3-451f-856a-5e961db44295 tempest-LiveMigrationTest-875310508 None] attachment_update completed successfully.
Aug 06 21:02:58.429030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:02:58.485137 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (3269af12-d984-43f0-9b3a-2136e688a9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:58.502149 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16dbd1e-db36-482e-905f-7434751053f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.561059 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e16dbd1e-db36-482e-905f-7434751053f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:02:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-129907201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b158f367-0386-45c5-9634-fa98c720244b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ed29bedd5e4f4788958bad354166f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:02:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:02:58Z,use_quota=True,user_id='78f7a58ae0b24b6a9aca96713dfe99b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.580560 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33bb972-0810-4044-bf77-7be7de2ec5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.601443 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33bb972-0810-4044-bf77-7be7de2ec5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.609828 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a40c14-427a-4641-85fc-20ea5e3d75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.615607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a40c14-427a-4641-85fc-20ea5e3d75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b158f367-0386-45c5-9634-fa98c720244b', 'volume_name': 'volume-b158f367-0386-45c5-9634-fa98c720244b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.621444 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62a402-4b45-4276-86ea-f8f79e46542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.626450 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a62a402-4b45-4276-86ea-f8f79e46542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.631680 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ac2d9b-e891-47c5-8829-f6ce0f2971d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.633402 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Volume b158f367-0386-45c5-9634-fa98c720244b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b158f367-0386-45c5-9634-fa98c720244b', 'volume_size': 1}
Aug 06 21:02:58.634022 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] creating volume 'volume-b158f367-0386-45c5-9634-fa98c720244b' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:02:58.635228 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:02:58.803392 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:02:58.804310 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:02:58.814838 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ac2d9b-e891-47c5-8829-f6ce0f2971d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b158f367-0386-45c5-9634-fa98c720244b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.821073 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4c278e-6a73-4dfd-88a6-9faa9753b03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:02:58.838583 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Volume volume-b158f367-0386-45c5-9634-fa98c720244b (b158f367-0386-45c5-9634-fa98c720244b): created successfully
Aug 06 21:02:58.847001 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4c278e-6a73-4dfd-88a6-9faa9753b03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:02:58.860241 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Flow 'volume_create_manager' (3269af12-d984-43f0-9b3a-2136e688a9cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:02:58.882583 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1d68e922-dc86-4258-928f-1923e6e603bf tempest-TaggedBootDevicesTest-335631018 None] Created volume successfully.
Aug 06 21:03:09.446938 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-da63966a-06aa-4138-94b2-6156b40d0078 req-b61024db-905b-4d54-a834-8ce8bf6b4229 tempest-LiveMigrationTest-363032342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:03:11.359691 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-da63966a-06aa-4138-94b2-6156b40d0078 req-b61024db-905b-4d54-a834-8ce8bf6b4229 tempest-LiveMigrationTest-363032342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.909s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:03:11.363160 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-da63966a-06aa-4138-94b2-6156b40d0078 req-b61024db-905b-4d54-a834-8ce8bf6b4229 tempest-LiveMigrationTest-363032342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'aa673255-11d9-4633-b5e3-fd8bc6522a18', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:03:11.446285 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-da63966a-06aa-4138-94b2-6156b40d0078 req-b61024db-905b-4d54-a834-8ce8bf6b4229 tempest-LiveMigrationTest-363032342 None] Connection info returned from driver {'name': 'volumes/volume-aa673255-11d9-4633-b5e3-fd8bc6522a18', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'aa673255-11d9-4633-b5e3-fd8bc6522a18', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '0d2660e8-630c-4da2-9377-eb44e1edab1a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:03:11.559155 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-da63966a-06aa-4138-94b2-6156b40d0078 req-b61024db-905b-4d54-a834-8ce8bf6b4229 tempest-LiveMigrationTest-363032342 None] attachment_update completed successfully.
Aug 06 21:03:20.692493 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:03:20.693593 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:03:20.773951 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:03:20.868594 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:03:22.062031 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=51,cinder:UPDATE=11,cinder:INSERT=7,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:03:23.049511 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=59,cinder:UPDATE=14,cinder:INSERT=5,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:03:23.077674 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-da63966a-06aa-4138-94b2-6156b40d0078 req-bcc0f750-55c3-492c-81db-4def662ff4d4 tempest-LiveMigrationTest-363032342 None] Terminate volume connection completed successfully.
Aug 06 21:03:23.079921 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-da63966a-06aa-4138-94b2-6156b40d0078 req-bcc0f750-55c3-492c-81db-4def662ff4d4 tempest-LiveMigrationTest-363032342 None] Deleting attachment e602ffdb-411b-4cd3-a770-5bbe7c0b33f5. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:03:33.060137 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:03:33.455732 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-50b5bf45-33cc-4d31-9c50-45c33f37cc34 tempest-TaggedBootDevicesTest-335631018 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:03:34.805427 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-50b5bf45-33cc-4d31-9c50-45c33f37cc34 tempest-TaggedBootDevicesTest-335631018 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.347s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:03:34.806868 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-50b5bf45-33cc-4d31-9c50-45c33f37cc34 tempest-TaggedBootDevicesTest-335631018 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:03:34.898311 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-50b5bf45-33cc-4d31-9c50-45c33f37cc34 tempest-TaggedBootDevicesTest-335631018 None] Connection info returned from driver {'name': 'volumes/volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1c50e947-04ab-4f1c-af43-9bdf85fe71c4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '6cabb4ec-b6ee-44db-a64c-7f7d8256c3d7'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:03:35.003288 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-50b5bf45-33cc-4d31-9c50-45c33f37cc34 tempest-TaggedBootDevicesTest-335631018 None] attachment_update completed successfully.
Aug 06 21:03:35.459480 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-2d53cebb-af92-4241-987e-766f95808aa3 tempest-TaggedBootDevicesTest-335631018 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:03:36.715785 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-2d53cebb-af92-4241-987e-766f95808aa3 tempest-TaggedBootDevicesTest-335631018 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.258s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:03:36.716695 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-2d53cebb-af92-4241-987e-766f95808aa3 tempest-TaggedBootDevicesTest-335631018 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:03:36.780189 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-4cf14529-e191-43fd-81db-9da2bccc2be8 req-c1fab6bb-2c10-4ecd-8d77-631d30f4746b tempest-LiveMigrationTest-875310508 None] Terminate volume connection completed successfully.
Aug 06 21:03:36.780613 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-4cf14529-e191-43fd-81db-9da2bccc2be8 req-c1fab6bb-2c10-4ecd-8d77-631d30f4746b tempest-LiveMigrationTest-875310508 None] Deleting attachment 0d2660e8-630c-4da2-9377-eb44e1edab1a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:03:36.827638 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-2d53cebb-af92-4241-987e-766f95808aa3 tempest-TaggedBootDevicesTest-335631018 None] Connection info returned from driver {'name': 'volumes/volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '34a5b6d3-a305-4945-9dd0-56f41d505480'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:03:36.946138 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-2d53cebb-af92-4241-987e-766f95808aa3 tempest-TaggedBootDevicesTest-335631018 None] attachment_update completed successfully.
Aug 06 21:03:37.441850 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-7493471d-8f69-4320-ae6e-675d996fb096 tempest-TaggedBootDevicesTest-335631018 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:03:38.650772 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-7493471d-8f69-4320-ae6e-675d996fb096 tempest-TaggedBootDevicesTest-335631018 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.211s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:03:38.652366 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-7493471d-8f69-4320-ae6e-675d996fb096 tempest-TaggedBootDevicesTest-335631018 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b158f367-0386-45c5-9634-fa98c720244b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'b158f367-0386-45c5-9634-fa98c720244b', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:03:38.739827 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-7493471d-8f69-4320-ae6e-675d996fb096 tempest-TaggedBootDevicesTest-335631018 None] Connection info returned from driver {'name': 'volumes/volume-b158f367-0386-45c5-9634-fa98c720244b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b158f367-0386-45c5-9634-fa98c720244b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ca6f68c8-2859-48b5-87a3-5a93df0ddd9a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:03:38.928956 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c13cb93d-2b86-407e-9ad0-10fe3e7fddef req-7493471d-8f69-4320-ae6e-675d996fb096 tempest-TaggedBootDevicesTest-335631018 None] attachment_update completed successfully.
Aug 06 21:03:39.540908 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:03:39.580388 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Flow 'volume_create_manager' (a0ed4435-6a89-48d7-946c-7fcc9bbdf462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:03:39.590995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee926f3-8886-403b-ad97-ff2f8112bd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:39.616411 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee926f3-8886-403b-ad97-ff2f8112bd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-525480244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4edf48a0-01d4-4349-bcb8-6225efa23271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e47f439135a6445fa29c8be6d69c1759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:03:39Z,use_quota=True,user_id='ad1a96004778407584d1805b07ad1c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:39.635694 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b1c5c9-c247-4c76-843f-97299b7d6737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:39.642779 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b1c5c9-c247-4c76-843f-97299b7d6737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:39.647337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9cafae-c353-4cc7-9ef9-a227c6179b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:39.779543 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9cafae-c353-4cc7-9ef9-a227c6179b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4edf48a0-01d4-4349-bcb8-6225efa23271', 'volume_name': 'volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c43af40>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:39.792248 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e09d9-656c-4150-b6ef-fad39eaaec9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:39.798293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a82e09d9-656c-4150-b6ef-fad39eaaec9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:39.805362 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7e9027-bd59-41fa-9446-3b3427eae3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:39.807182 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Volume 4edf48a0-01d4-4349-bcb8-6225efa23271: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c43af40>}
Aug 06 21:03:39.808252 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Cloning 4edf48a0-01d4-4349-bcb8-6225efa23271 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:03:39.810036 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:03:39.834152 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.024s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:03:39.852041 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 3, 39, 839214)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:03:39.852498 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:03:39.853281 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:03:39.859310 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:03:39.860167 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:03:39.871093 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 3, 39, 864951)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:03:39.872054 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:03:39.875346 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:03:39.892004 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:03:40.037503 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] creating snapshot='volume-4edf48a0-01d4-4349-bcb8-6225efa23271.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:03:40.904301 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-4edf48a0-01d4-4349-bcb8-6225efa23271.clone_snap' to 'volume-4edf48a0-01d4-4349-bcb8-6225efa23271' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:03:41.084209 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:03:41.085518 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:03:41.086024 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:03:41.109442 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:03:41.110189 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Marking volume 4edf48a0-01d4-4349-bcb8-6225efa23271 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:03:41.118802 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to 4edf48a0-01d4-4349-bcb8-6225efa23271. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:03:41.119992 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Creating volume glance metadata for volume 4edf48a0-01d4-4349-bcb8-6225efa23271 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:03:41.233939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e7e9027-bd59-41fa-9446-3b3427eae3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c43af40>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:41.243115 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac2eb0a-a014-4605-a9b0-8ddd36e840ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:03:41.259048 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Volume volume-4edf48a0-01d4-4349-bcb8-6225efa23271 (4edf48a0-01d4-4349-bcb8-6225efa23271): created successfully
Aug 06 21:03:41.264848 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac2eb0a-a014-4605-a9b0-8ddd36e840ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:03:41.273447 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Flow 'volume_create_manager' (a0ed4435-6a89-48d7-946c-7fcc9bbdf462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:03:41.290068 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-72f86e8e-5d62-44e2-8158-4fc5195bab6b tempest-LiveMigrationTest-875310508 None] Created volume successfully.
Aug 06 21:03:45.016821 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-81901fc8-aba9-496a-b21c-1476eb9454ea req-22b62b02-2d47-4839-829a-3c6f77890527 tempest-LiveMigrationTest-875310508 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:03:46.071294 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-81901fc8-aba9-496a-b21c-1476eb9454ea req-22b62b02-2d47-4839-829a-3c6f77890527 tempest-LiveMigrationTest-875310508 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.054s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:03:46.072427 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-81901fc8-aba9-496a-b21c-1476eb9454ea req-22b62b02-2d47-4839-829a-3c6f77890527 tempest-LiveMigrationTest-875310508 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '4edf48a0-01d4-4349-bcb8-6225efa23271', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:03:46.112844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-81901fc8-aba9-496a-b21c-1476eb9454ea req-22b62b02-2d47-4839-829a-3c6f77890527 tempest-LiveMigrationTest-875310508 None] Connection info returned from driver {'name': 'volumes/volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4edf48a0-01d4-4349-bcb8-6225efa23271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd79a33a3-0223-4e06-a077-c418c390d06e'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:03:46.213952 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-81901fc8-aba9-496a-b21c-1476eb9454ea req-22b62b02-2d47-4839-829a-3c6f77890527 tempest-LiveMigrationTest-875310508 None] attachment_update completed successfully.
Aug 06 21:04:02.058524 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=66,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:04:12.068835 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=65,cinder:UPDATE=12,cinder:INSERT=8,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:04:13.129705 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-dcc9ed83-5f9c-4431-a097-d5a3f0c2624a tempest-LiveMigrationTest-363032342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:04:14.020206 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-dcc9ed83-5f9c-4431-a097-d5a3f0c2624a tempest-LiveMigrationTest-363032342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.890s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:04:14.021407 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-dcc9ed83-5f9c-4431-a097-d5a3f0c2624a tempest-LiveMigrationTest-363032342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '4edf48a0-01d4-4349-bcb8-6225efa23271', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:04:14.056699 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-dcc9ed83-5f9c-4431-a097-d5a3f0c2624a tempest-LiveMigrationTest-363032342 None] Connection info returned from driver {'name': 'volumes/volume-4edf48a0-01d4-4349-bcb8-6225efa23271', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4edf48a0-01d4-4349-bcb8-6225efa23271', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '183547aa-e7d4-4f61-937e-6407be5bee2e'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:04:14.132278 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-dcc9ed83-5f9c-4431-a097-d5a3f0c2624a tempest-LiveMigrationTest-363032342 None] attachment_update completed successfully.
Aug 06 21:04:20.695696 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:04:20.697432 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:20.768184 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:20.800774 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:04:23.758302 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-df08106f-fb05-4a0c-b3dd-8f2438a35441 tempest-LiveMigrationTest-363032342 None] Terminate volume connection completed successfully.
Aug 06 21:04:23.758956 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-f26bd4fb-fc76-482e-acb1-d531ba6cae93 req-df08106f-fb05-4a0c-b3dd-8f2438a35441 tempest-LiveMigrationTest-363032342 None] Deleting attachment d79a33a3-0223-4e06-a077-c418c390d06e. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:04:33.758329 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:04:37.700213 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-40ace533-9ed2-4976-9dfc-be9dfc5fd738 tempest-LiveMigrationTest-875310508 None] Terminate volume connection completed successfully.
Aug 06 21:04:37.700838 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-40ace533-9ed2-4976-9dfc-be9dfc5fd738 tempest-LiveMigrationTest-875310508 None] Deleting attachment 183547aa-e7d4-4f61-937e-6407be5bee2e. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:04:37.922761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Acquiring lock "cinder-4edf48a0-01d4-4349-bcb8-6225efa23271-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:04:37.935564 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Lock "cinder-4edf48a0-01d4-4349-bcb8-6225efa23271-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:04:37.997851 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:38.137987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:04:38.153057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] deleting rbd volume volume-4edf48a0-01d4-4349-bcb8-6225efa23271 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:04:38.576321 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:04:38.616383 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] deleting parent snapshot volume-4edf48a0-01d4-4349-bcb8-6225efa23271.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:04:39.030728 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Created reservations ['da2bc3b0-1a56-45d2-9487-e39c79b9ea8f', '00884f6a-53cb-4d61-a425-5c13ec3e0a2d', '2ada9102-cfba-457a-a581-f050b37bcb2a', 'cad34a8e-ebbd-453d-b7b4-038969bc9148'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:04:39.106794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:39.184835 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:39.260896 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:04:39.267383 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Deleted volume successfully.
Aug 06 21:04:39.294072 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-a9ea6696-677d-47f1-8f76-593c15c37f81 req-f17f9cb7-acae-44b0-b367-cae4a710f259 tempest-LiveMigrationTest-875310508 None] Lock "cinder-4edf48a0-01d4-4349-bcb8-6225efa23271-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:04:41.266534 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Acquiring lock "cinder-aa673255-11d9-4633-b5e3-fd8bc6522a18-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:04:41.281545 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Lock "cinder-aa673255-11d9-4633-b5e3-fd8bc6522a18-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:04:41.398658 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:41.521586 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:04:41.521962 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Volume volume-aa673255-11d9-4633-b5e3-fd8bc6522a18 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:04:41.533008 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] deleting rbd volume volume-aa673255-11d9-4633-b5e3-fd8bc6522a18 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:04:42.160537 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=37,cinder:UPDATE=20 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:04:42.234913 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Created reservations ['d1ed6303-c297-44f4-acde-daa7e7252c5e', '6a2bfa49-10ce-42e6-8d80-88fa1b89cacd', '597fdcfc-8152-40cf-a312-d907442d46c1', '556d8d21-c3a0-40fa-a6a0-72fbe3673e70'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:04:42.354569 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:42.427451 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:04:42.493173 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:04:42.499538 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Deleted volume successfully.
Aug 06 21:04:42.528110 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-56bc6cb8-04c3-46b7-91c6-7c0c5afd5cb0 tempest-LiveMigrationTest-875310508 None] Lock "cinder-aa673255-11d9-4633-b5e3-fd8bc6522a18-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:05:12.077264 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=35,cinder:INSERT=6,cinder:DELETE=2,cinder:UPDATE=9 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:05:20.701683 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:05:20.701683 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:05:20.756083 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:05:20.827680 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:05:22.083681 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:INSERT=2,cinder:UPDATE=10,cinder:SELECT=10 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:05:32.100854 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:02.078466 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:05.140634 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:05.146459 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-62e9193f-afb8-44ba-8c22-49420b773ae6 tempest-TaggedBootDevicesTest_v242-144839246 None] Terminate volume connection completed successfully.
Aug 06 21:06:05.148260 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-62e9193f-afb8-44ba-8c22-49420b773ae6 tempest-TaggedBootDevicesTest_v242-144839246 None] Deleting attachment 5a9d3fc6-7297-437d-90d5-8c4e7edf909a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:06:05.357772 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-a62c4bf2-78d9-427f-aee4-bf9a83e3ccb7 tempest-TaggedBootDevicesTest_v242-144839246 None] Terminate volume connection completed successfully.
Aug 06 21:06:05.358197 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-a62c4bf2-78d9-427f-aee4-bf9a83e3ccb7 tempest-TaggedBootDevicesTest_v242-144839246 None] Deleting attachment 48dd9ae8-1d7b-45fb-81b4-e8fecd81fa7c. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:06:05.512963 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-3026f715-cc10-4623-9a7d-b128d678851a tempest-TaggedBootDevicesTest_v242-144839246 None] Terminate volume connection completed successfully.
Aug 06 21:06:05.513675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-1db3fd9e-c665-4aee-8428-48e8269ed42e req-3026f715-cc10-4623-9a7d-b128d678851a tempest-TaggedBootDevicesTest_v242-144839246 None] Deleting attachment e791e2d2-a163-4469-9c8e-dc662ba87e4c. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:06:20.707027 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:06:20.707738 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:20.772494 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:20.833166 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:06:22.081957 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:22.212600 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Acquiring lock "cinder-a2a66353-40fa-4672-99aa-9f8e137e1126-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:06:22.229173 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-a2a66353-40fa-4672-99aa-9f8e137e1126-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:06:22.296079 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:22.405600 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:06:22.406074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-a2a66353-40fa-4672-99aa-9f8e137e1126 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:06:22.418672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] deleting rbd volume volume-a2a66353-40fa-4672-99aa-9f8e137e1126 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:06:22.879187 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Created reservations ['6ea96bb8-71c1-4203-b082-8b0528aed9f2', 'daab344d-dd86-42f2-8e9b-835e5516fc86', 'a8ecd577-08d4-4fba-810b-425442caaceb', 'd4baf3c4-2e4d-447b-b838-3b31adbf4f91'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:06:22.976426 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:23.071943 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:23.155248 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:06:23.162009 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Deleted volume successfully.
Aug 06 21:06:23.195351 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9d512ab0-6260-4c8d-8ee5-1fe8aaa74394 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-a2a66353-40fa-4672-99aa-9f8e137e1126-delete_volume" released by "delete_volume" :: held 0.966s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:06:23.467505 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Acquiring lock "cinder-4297f47d-31a4-4957-9809-e323b1575be7-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:06:23.478944 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-4297f47d-31a4-4957-9809-e323b1575be7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:06:23.519526 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:23.604308 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:06:23.604729 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Volume volume-4297f47d-31a4-4957-9809-e323b1575be7 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:06:23.610570 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] deleting rbd volume volume-4297f47d-31a4-4957-9809-e323b1575be7 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:06:24.108746 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Created reservations ['28514738-b02b-41e6-8d64-014be554cda0', '0018bd4c-d5e7-442f-9ac3-d94008716079', 'ca84e758-6376-49f3-a9cb-dd9aa0dc25e8', '37866c6e-656e-4169-a0c7-8b57c6adbf4a'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:06:24.200251 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:24.287646 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:24.371882 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:06:24.386166 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Deleted volume successfully.
Aug 06 21:06:24.407113 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55b7354c-c2a3-4540-9820-2eb986e0f651 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-4297f47d-31a4-4957-9809-e323b1575be7-delete_volume" released by "delete_volume" :: held 0.928s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:06:24.761925 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Acquiring lock "cinder-2381464f-8d79-4e5e-8926-b919fcd72240-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:06:24.780756 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-2381464f-8d79-4e5e-8926-b919fcd72240-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:06:24.896003 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:25.033324 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:06:25.041200 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] deleting rbd volume volume-2381464f-8d79-4e5e-8926-b919fcd72240 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:06:25.396685 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:06:25.444445 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] deleting parent snapshot volume-2381464f-8d79-4e5e-8926-b919fcd72240.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:06:26.472906 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Created reservations ['43ee8716-faf8-49f3-a200-da2a79529fe8', '5a43ba56-77e0-43e4-9469-82e57b40ab8b', '7607d65b-062a-4b2e-ba30-0970e4901b70', 'd428878f-eaa5-45c4-b9ba-67d7519a6caf'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:06:26.605273 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:26.683771 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:26.763603 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:06:26.768283 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Deleted volume successfully.
Aug 06 21:06:26.795424 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68be0cfa-ec47-46a9-8691-6375ccac2079 tempest-TaggedBootDevicesTest_v242-144839246 None] Lock "cinder-2381464f-8d79-4e5e-8926-b919fcd72240-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:06:42.095028 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=52,cinder:UPDATE=30,cinder:INSERT=3,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:50.218283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:06:50.294742 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Flow 'volume_create_manager' (e25f457b-960a-4452-bdab-14113c82d399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:06:50.307655 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f279038-5a89-4aa6-9dad-5460d35de75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.344586 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f279038-5a89-4aa6-9dad-5460d35de75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1841465239',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=e6ea7076-822c-4b14-984a-9e1a1f380625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe2ae1b1c16d4dedb2585dde7dab8113',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:06:50Z,use_quota=True,user_id='bdf1b5180a814cf39234892c6c1f26df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.359537 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce3a6c1-ce02-4d18-b397-acd83ef58a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.364955 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ce3a6c1-ce02-4d18-b397-acd83ef58a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.388848 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69be304a-a627-47d0-a88c-2a42537619d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.401021 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69be304a-a627-47d0-a88c-2a42537619d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ea7076-822c-4b14-984a-9e1a1f380625', 'volume_name': 'volume-e6ea7076-822c-4b14-984a-9e1a1f380625', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.415444 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9faa73ab-d0cd-463f-acb1-63a97d789cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.424820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9faa73ab-d0cd-463f-acb1-63a97d789cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.433189 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fc87c0-cb7f-4428-ae88-91c6a3af2532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.434295 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Volume e6ea7076-822c-4b14-984a-9e1a1f380625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ea7076-822c-4b14-984a-9e1a1f380625', 'volume_size': 1}
Aug 06 21:06:50.434731 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] creating volume 'volume-e6ea7076-822c-4b14-984a-9e1a1f380625' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:06:50.444183 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:06:50.570733 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:06:50.571338 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:06:50.575407 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fc87c0-cb7f-4428-ae88-91c6a3af2532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ea7076-822c-4b14-984a-9e1a1f380625', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.587782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ab5503-1723-4c63-bd62-649a709471d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:06:50.614093 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Volume volume-e6ea7076-822c-4b14-984a-9e1a1f380625 (e6ea7076-822c-4b14-984a-9e1a1f380625): created successfully
Aug 06 21:06:50.618748 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ab5503-1723-4c63-bd62-649a709471d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:06:50.657180 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Flow 'volume_create_manager' (e25f457b-960a-4452-bdab-14113c82d399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:06:50.685683 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5568e50b-f9d4-4b3d-a01d-2c4a7efe98f4 tempest-DeleteServersTestJSON-1467588605 None] Created volume successfully.
Aug 06 21:06:52.064424 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d req-8cc81ade-fa7e-4bd0-bec7-d7e0c67e23d3 tempest-DeleteServersTestJSON-1467588605 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:06:53.579750 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d req-8cc81ade-fa7e-4bd0-bec7-d7e0c67e23d3 tempest-DeleteServersTestJSON-1467588605 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.515s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:06:53.580506 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d req-8cc81ade-fa7e-4bd0-bec7-d7e0c67e23d3 tempest-DeleteServersTestJSON-1467588605 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e6ea7076-822c-4b14-984a-9e1a1f380625', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'e6ea7076-822c-4b14-984a-9e1a1f380625', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:06:53.593907 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=44,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:06:53.619188 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d req-8cc81ade-fa7e-4bd0-bec7-d7e0c67e23d3 tempest-DeleteServersTestJSON-1467588605 None] Connection info returned from driver {'name': 'volumes/volume-e6ea7076-822c-4b14-984a-9e1a1f380625', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e6ea7076-822c-4b14-984a-9e1a1f380625', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7a364afb-e1d4-4d26-abb0-d2240b145c3a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:06:53.750253 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-adfbe917-f756-4d7a-bbd6-f2c4e2cf0d1d req-8cc81ade-fa7e-4bd0-bec7-d7e0c67e23d3 tempest-DeleteServersTestJSON-1467588605 None] attachment_update completed successfully.
Aug 06 21:07:01.345646 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-dde429cc-2683-47bd-af77-5df3d003f0a7 req-952b2407-a879-4400-b198-a3c658a43207 tempest-DeleteServersTestJSON-1467588605 None] Terminate volume connection completed successfully.
Aug 06 21:07:01.346884 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-dde429cc-2683-47bd-af77-5df3d003f0a7 req-952b2407-a879-4400-b198-a3c658a43207 tempest-DeleteServersTestJSON-1467588605 None] Deleting attachment 7a364afb-e1d4-4d26-abb0-d2240b145c3a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:07:11.331625 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:07:20.703993 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:07:20.705478 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:07:20.802739 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:07:20.905102 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:07:22.099604 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=28,cinder:UPDATE=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:07:31.545226 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:07:31.589552 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Flow 'volume_create_manager' (777fca1b-e8b9-45a4-99a9-46e625c4fcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:07:31.599709 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782c20ce-ef49-428b-afe7-679fa0d7d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.625952 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (782c20ce-ef49-428b-afe7-679fa0d7d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1069905887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=05b97652-8690-49da-8129-7f7b2bc838b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046f1ab9c004060965dced02db4b7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:07:31Z,use_quota=True,user_id='f7cf258df10248d0bdcf64fa075c132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.631447 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13901af-6eb9-443e-a0be-98387c14aeb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.636293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13901af-6eb9-443e-a0be-98387c14aeb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.641868 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d6fba0-1400-4f84-bffb-293320ebb4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.646104 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0d6fba0-1400-4f84-bffb-293320ebb4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b97652-8690-49da-8129-7f7b2bc838b6', 'volume_name': 'volume-05b97652-8690-49da-8129-7f7b2bc838b6', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.651915 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c47dc-b9b4-46e9-a262-06ff69a231d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.660119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65c47dc-b9b4-46e9-a262-06ff69a231d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.681092 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc0c57a-6957-463d-9ee6-eeb6993b743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.682690 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume 05b97652-8690-49da-8129-7f7b2bc838b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b97652-8690-49da-8129-7f7b2bc838b6', 'volume_size': 1}
Aug 06 21:07:31.683147 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] creating volume 'volume-05b97652-8690-49da-8129-7f7b2bc838b6' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:07:31.683873 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:07:31.819737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:07:31.820367 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:07:31.824261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc0c57a-6957-463d-9ee6-eeb6993b743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b97652-8690-49da-8129-7f7b2bc838b6', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.832987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520e364b-af6d-48f3-973d-9c0afa77072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:31.859841 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume volume-05b97652-8690-49da-8129-7f7b2bc838b6 (05b97652-8690-49da-8129-7f7b2bc838b6): created successfully
Aug 06 21:07:31.865044 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520e364b-af6d-48f3-973d-9c0afa77072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:31.874897 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Flow 'volume_create_manager' (777fca1b-e8b9-45a4-99a9-46e625c4fcbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:07:31.898472 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-42e0f817-ddc0-48bc-9a79-9f8534893650 tempest-ServerRescueNegativeTestJSON-1101172257 None] Created volume successfully.
Aug 06 21:07:42.108315 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:07:54.306765 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:07:54.337102 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:07:54.382185 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Flow 'volume_create_manager' (6f458775-4045-4275-96c5-f942c3a10d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:07:54.398534 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6edec2-a8d7-4a58-9719-d7065b38569c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:54.418338 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6edec2-a8d7-4a58-9719-d7065b38569c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-520388579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=01cb2a8d-b4b3-4606-91b2-8f969ffe983b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3389d5492b224ef9963f6305139ae9b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:07:54Z,use_quota=True,user_id='469d18e4c7db4b0d989f7c5b72e744f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:54.425692 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24bbe13-28de-4090-ac43-b84e418279a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:54.431483 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24bbe13-28de-4090-ac43-b84e418279a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:54.441529 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e61d0e-23c4-4125-934a-4346ad7e297b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:54.605675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9e61d0e-23c4-4125-934a-4346ad7e297b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'volume_name': 'volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a039700>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:54.618720 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c5fe0f-d9b4-4c7d-be53-f4ad8a58aad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:54.638176 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c5fe0f-d9b4-4c7d-be53-f4ad8a58aad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:54.660290 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac8d7ba-b513-4e1b-9d67-e6c456a7d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:54.661459 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Volume 01cb2a8d-b4b3-4606-91b2-8f969ffe983b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a039700>}
Aug 06 21:07:54.669987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Cloning 01cb2a8d-b4b3-4606-91b2-8f969ffe983b from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:07:54.674585 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:07:54.703958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.033s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:07:54.732554 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 7, 54, 722319)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:07:54.733002 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:07:54.733497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:07:54.753463 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.049s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:07:54.754443 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:07:54.789436 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 7, 54, 773002)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:07:54.789910 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:07:54.790317 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:07:54.825851 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:07:54.929066 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] creating snapshot='volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:07:55.430004 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b.clone_snap' to 'volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:07:55.653809 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:07:55.655066 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:07:55.655508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:07:55.717759 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:07:55.718476 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Marking volume 01cb2a8d-b4b3-4606-91b2-8f969ffe983b as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:07:55.733027 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to 01cb2a8d-b4b3-4606-91b2-8f969ffe983b. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:07:55.733480 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Creating volume glance metadata for volume 01cb2a8d-b4b3-4606-91b2-8f969ffe983b backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:07:55.866776 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac8d7ba-b513-4e1b-9d67-e6c456a7d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a039700>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:55.871620 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57af89d-cbdb-40b1-aeeb-a5ca2fca21a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:07:55.899819 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Volume volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b (01cb2a8d-b4b3-4606-91b2-8f969ffe983b): created successfully
Aug 06 21:07:55.904027 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57af89d-cbdb-40b1-aeeb-a5ca2fca21a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:07:55.911812 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Flow 'volume_create_manager' (6f458775-4045-4275-96c5-f942c3a10d11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:07:55.953365 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c8be42e8-e475-49e0-99f7-cb97b898a398 tempest-ServersTestBootFromVolume-463747702 None] Created volume successfully.
Aug 06 21:08:01.688558 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 req-b80acb60-c8f5-43f8-84fd-d35e7f0f4209 tempest-ServersTestBootFromVolume-463747702 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:08:03.632956 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 req-b80acb60-c8f5-43f8-84fd-d35e7f0f4209 tempest-ServersTestBootFromVolume-463747702 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.944s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:08:03.633987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 req-b80acb60-c8f5-43f8-84fd-d35e7f0f4209 tempest-ServersTestBootFromVolume-463747702 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:08:03.698475 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 req-b80acb60-c8f5-43f8-84fd-d35e7f0f4209 tempest-ServersTestBootFromVolume-463747702 None] Connection info returned from driver {'name': 'volumes/volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01cb2a8d-b4b3-4606-91b2-8f969ffe983b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1a8e46c2-6e50-4a0d-9c3b-aeab44e5fe9a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:08:03.867684 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-39efc1c7-ec51-4e37-bc8d-0d25660d16a2 req-b80acb60-c8f5-43f8-84fd-d35e7f0f4209 tempest-ServersTestBootFromVolume-463747702 None] attachment_update completed successfully.
Aug 06 21:08:07.288523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:08:07.435293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Flow 'volume_create_manager' (b1c374ea-eed0-4a3f-9f91-bb3a994a4b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:07.455043 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70019b11-16b6-41b6-92d6-6ba8834d5c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.500514 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70019b11-16b6-41b6-92d6-6ba8834d5c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1680052652',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8046f1ab9c004060965dced02db4b7c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:08:07Z,use_quota=True,user_id='f7cf258df10248d0bdcf64fa075c132c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.509343 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82c410-138f-4306-9acf-f5b6165a7a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.515988 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82c410-138f-4306-9acf-f5b6165a7a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.523848 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e68341-8e4f-4197-90cd-4f25eb15e3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.529960 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2e68341-8e4f-4197-90cd-4f25eb15e3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'volume_name': 'volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.536491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b9994a-8f7f-4fab-b5e2-f861727d2d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.542618 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b9994a-8f7f-4fab-b5e2-f861727d2d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.548650 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040631b6-1437-493a-9636-346c1e4b185f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.550308 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'volume_size': 1}
Aug 06 21:08:07.550904 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] creating volume 'volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:08:07.551818 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:07.719895 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:08:07.720623 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:08:07.727582 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (040631b6-1437-493a-9636-346c1e4b185f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.734121 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb747c39-742c-44cd-91b8-0307844edcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:07.750849 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 (ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8): created successfully
Aug 06 21:08:07.759488 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb747c39-742c-44cd-91b8-0307844edcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:07.767845 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Flow 'volume_create_manager' (b1c374ea-eed0-4a3f-9f91-bb3a994a4b47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:07.785774 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-993640a4-ac10-4ba5-9205-285f733c1866 tempest-ServerRescueNegativeTestJSON-1101172257 None] Created volume successfully.
Aug 06 21:08:09.141764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:08:09.198248 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (86b975d9-5aad-4a8c-b63d-5bfba95b2c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:09.214476 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a00817-d233-4043-94db-71163320e5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.257138 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a00817-d233-4043-94db-71163320e5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1899785877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fcc64e14-d1d4-4460-bb5d-5ef822044936,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='561e7cedf06f4664895ec6ee3a6678ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:08:09Z,use_quota=True,user_id='8fa068c89e234ea084cd1129f049f861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.273653 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5411c842-6850-4e40-a15a-ec6a502e415a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.282574 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5411c842-6850-4e40-a15a-ec6a502e415a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.310426 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0db1d6e-025e-45e4-a4b8-592e120b5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.342409 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0db1d6e-025e-45e4-a4b8-592e120b5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcc64e14-d1d4-4460-bb5d-5ef822044936', 'volume_name': 'volume-fcc64e14-d1d4-4460-bb5d-5ef822044936', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.361095 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b17b416-3510-483c-ba18-57d7991606ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.365950 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b17b416-3510-483c-ba18-57d7991606ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.412995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ec0969-8684-4a6a-bb85-ed65ff799a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.414015 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Volume fcc64e14-d1d4-4460-bb5d-5ef822044936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcc64e14-d1d4-4460-bb5d-5ef822044936', 'volume_size': 1}
Aug 06 21:08:09.414428 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] creating volume 'volume-fcc64e14-d1d4-4460-bb5d-5ef822044936' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:08:09.424009 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:09.594213 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:08:09.594509 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:08:09.598129 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0ec0969-8684-4a6a-bb85-ed65ff799a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcc64e14-d1d4-4460-bb5d-5ef822044936', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.603436 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09f7e06-5e4b-453c-84f4-1c6cda8d5f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:09.636207 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Volume volume-fcc64e14-d1d4-4460-bb5d-5ef822044936 (fcc64e14-d1d4-4460-bb5d-5ef822044936): created successfully
Aug 06 21:08:09.640077 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09f7e06-5e4b-453c-84f4-1c6cda8d5f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:09.661142 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (86b975d9-5aad-4a8c-b63d-5bfba95b2c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:09.682846 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-67d4743c-6307-475d-a243-545e34d0a01f tempest-VolumesTestJSON-438187184 None] Created volume successfully.
Aug 06 21:08:12.281261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:08:12.325788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (3f85e741-1a47-43ba-91d5-4896af57fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:12.341075 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13657bad-51ad-4f54-9922-20aa80d23426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.374611 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13657bad-51ad-4f54-9922-20aa80d23426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2104656783',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3785f13e-1fa3-4bc0-8cc8-f2a3c1254403,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='561e7cedf06f4664895ec6ee3a6678ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:08:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:08:12Z,use_quota=True,user_id='8fa068c89e234ea084cd1129f049f861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.393820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57465b-21ff-45cf-ae6d-7c89d42e6828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.401366 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a57465b-21ff-45cf-ae6d-7c89d42e6828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.423083 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4964ee-c120-4dbc-b630-18e2dea88e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.427691 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4964ee-c120-4dbc-b630-18e2dea88e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3785f13e-1fa3-4bc0-8cc8-f2a3c1254403', 'volume_name': 'volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.435610 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec937e9-b0af-497c-9f07-c3c1546f932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.453834 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ec937e9-b0af-497c-9f07-c3c1546f932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.460110 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb846588-6523-451a-b3d2-ab1789aee8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.461837 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Volume 3785f13e-1fa3-4bc0-8cc8-f2a3c1254403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403', 'volume_size': 1}
Aug 06 21:08:12.462468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] creating volume 'volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:08:12.464603 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:12.656648 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:08:12.657334 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:08:12.661108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb846588-6523-451a-b3d2-ab1789aee8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.669459 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac74c64-1aab-44e9-81cf-19a715a028fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:12.707804 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Volume volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403 (3785f13e-1fa3-4bc0-8cc8-f2a3c1254403): created successfully
Aug 06 21:08:12.707804 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac74c64-1aab-44e9-81cf-19a715a028fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:12.725799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (3f85e741-1a47-43ba-91d5-4896af57fead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:12.757652 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-41b24f21-775c-42c4-b2d0-66afd662f0e9 tempest-VolumesTestJSON-438187184 None] Created volume successfully.
Aug 06 21:08:14.702674 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:08:14.824065 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (d609dd71-75ee-463c-85e2-7f18463d8a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:14.832423 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35447424-0b71-4725-bf47-939820d9c9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:14.952517 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35447424-0b71-4725-bf47-939820d9c9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1624985824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=fdaaf046-23a1-4673-a41d-cfde13fd77e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='561e7cedf06f4664895ec6ee3a6678ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:08:15Z,use_quota=True,user_id='8fa068c89e234ea084cd1129f049f861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:14.968639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c813fd6c-be91-4913-bae8-ae597d77d247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:14.973463 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c813fd6c-be91-4913-bae8-ae597d77d247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:14.982887 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada2c465-06bb-4437-86cc-165c1c68ceea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:14.988110 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ada2c465-06bb-4437-86cc-165c1c68ceea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdaaf046-23a1-4673-a41d-cfde13fd77e7', 'volume_name': 'volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:14.995188 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f68ca1-4173-4dea-bacf-13745595aebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:15.001254 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09f68ca1-4173-4dea-bacf-13745595aebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:15.010846 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4c066d-d1bc-43f4-bb73-c98bb98a6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:15.012439 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Volume fdaaf046-23a1-4673-a41d-cfde13fd77e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7', 'volume_size': 1}
Aug 06 21:08:15.013052 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] creating volume 'volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:08:15.013913 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:15.186916 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:08:15.187479 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:08:15.193977 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c4c066d-d1bc-43f4-bb73-c98bb98a6597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:15.206793 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48db5bc9-9d70-4361-b574-f06cbf199307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:08:15.227819 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Volume volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7 (fdaaf046-23a1-4673-a41d-cfde13fd77e7): created successfully
Aug 06 21:08:15.235116 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48db5bc9-9d70-4361-b574-f06cbf199307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:08:15.249092 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Flow 'volume_create_manager' (d609dd71-75ee-463c-85e2-7f18463d8a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:08:15.275247 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ff505de4-1cf5-4bbc-92c1-491f3238a6b8 tempest-VolumesTestJSON-438187184 None] Created volume successfully.
Aug 06 21:08:20.708058 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:08:20.708831 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:20.787802 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:20.841433 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:21.251210 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Acquiring lock "cinder-fdaaf046-23a1-4673-a41d-cfde13fd77e7-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:21.263249 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Lock "cinder-fdaaf046-23a1-4673-a41d-cfde13fd77e7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:21.304182 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:21.394205 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:21.394774 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Volume volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:08:21.405817 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] deleting rbd volume volume-fdaaf046-23a1-4673-a41d-cfde13fd77e7 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:21.951126 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Created reservations ['555c9228-9649-45d4-8272-6af85c1c1e12', '3d6ea470-ec23-455c-b063-fe9faff9d8f1', '48d6390e-37ad-4641-9a34-151c27911cc1', 'e0c3ac5f-84ac-4df1-8f60-d91e44e1598a'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:22.052764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:22.117085 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:22.217369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:22.223272 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=55,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:08:22.225646 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Deleted volume successfully.
Aug 06 21:08:22.279951 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-38a4f5ad-0e36-4add-aa03-185308359388 tempest-VolumesTestJSON-438187184 None] Lock "cinder-fdaaf046-23a1-4673-a41d-cfde13fd77e7-delete_volume" released by "delete_volume" :: held 1.016s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:22.498237 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Acquiring lock "cinder-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:22.511981 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Lock "cinder-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:22.608536 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:22.699510 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:22.701074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Volume volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:08:22.717845 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] deleting rbd volume volume-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:23.085383 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=69,cinder:UPDATE=14,cinder:INSERT=14,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:08:23.101052 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Created reservations ['ae409106-9580-47a1-bd7c-1a00105d62ae', '0106cd76-9830-4990-b924-9d6ff04b1a65', 'd24dcaec-699d-4216-a18e-0bb2adcd244b', 'c4635d96-0bde-4fc6-ae11-9cb1f6b2f695'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:23.160804 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:23.230954 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:23.319939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:23.327522 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Deleted volume successfully.
Aug 06 21:08:23.355845 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-89eb63de-1a97-4597-a986-005d4645d7bc tempest-VolumesTestJSON-438187184 None] Lock "cinder-3785f13e-1fa3-4bc0-8cc8-f2a3c1254403-delete_volume" released by "delete_volume" :: held 0.844s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:23.774293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Acquiring lock "cinder-fcc64e14-d1d4-4460-bb5d-5ef822044936-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:23.818313 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Lock "cinder-fcc64e14-d1d4-4460-bb5d-5ef822044936-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:23.882595 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:24.007760 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:24.008172 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Volume volume-fcc64e14-d1d4-4460-bb5d-5ef822044936 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:08:24.026612 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] deleting rbd volume volume-fcc64e14-d1d4-4460-bb5d-5ef822044936 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:24.582221 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Created reservations ['83f00ce8-9b87-4b1b-8c2d-8dad520d7293', '69fe21e7-55b8-4364-9861-cd6b4e75aa49', '93213fb1-2f4a-4277-b823-0193e1143302', '96767fea-d6d6-4c3b-a57f-521119c9787a'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:24.648497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:24.729645 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:24.799773 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:24.804283 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Deleted volume successfully.
Aug 06 21:08:24.823213 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9745ac7b-0714-496c-97f9-38a5482dbfcf tempest-VolumesTestJSON-438187184 None] Lock "cinder-fcc64e14-d1d4-4460-bb5d-5ef822044936-delete_volume" released by "delete_volume" :: held 1.002s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:29.674080 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-68c9a599-cccc-4162-8051-d2be0e4c933a tempest-TaggedBootDevicesTest-335631018 None] Terminate volume connection completed successfully.
Aug 06 21:08:29.674725 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-68c9a599-cccc-4162-8051-d2be0e4c933a tempest-TaggedBootDevicesTest-335631018 None] Deleting attachment 6cabb4ec-b6ee-44db-a64c-7f7d8256c3d7. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:08:29.880745 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-2f66d367-18bc-46fb-a59f-d79f2d9bc45d tempest-TaggedBootDevicesTest-335631018 None] Terminate volume connection completed successfully.
Aug 06 21:08:29.881151 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-2f66d367-18bc-46fb-a59f-d79f2d9bc45d tempest-TaggedBootDevicesTest-335631018 None] Deleting attachment 34a5b6d3-a305-4945-9dd0-56f41d505480. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:08:30.110179 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-626cbb2a-80b1-4cc6-8933-2d85fdcfbba1 tempest-TaggedBootDevicesTest-335631018 None] Terminate volume connection completed successfully.
Aug 06 21:08:30.110435 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-7beb7d0c-63af-4895-b5a8-2c9a5086b897 req-626cbb2a-80b1-4cc6-8933-2d85fdcfbba1 tempest-TaggedBootDevicesTest-335631018 None] Deleting attachment ca6f68c8-2859-48b5-87a3-5a93df0ddd9a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:08:42.222351 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=34,cinder:UPDATE=13,cinder:INSERT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:08:42.969843 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Acquiring lock "cinder-b158f367-0386-45c5-9634-fa98c720244b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:42.988013 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-b158f367-0386-45c5-9634-fa98c720244b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:43.154189 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:43.228298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:43.228963 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Volume volume-b158f367-0386-45c5-9634-fa98c720244b is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:08:43.241428 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] deleting rbd volume volume-b158f367-0386-45c5-9634-fa98c720244b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:43.602063 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Created reservations ['723e0595-df1d-4e1c-9fc4-18174019d71e', '24ac9368-0be6-402f-84b5-954184fdbea1', 'feafc70f-c371-447a-8e12-6918f0c09c0f', 'c27544d5-e3be-42c0-8bf8-62afbfedb943'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:43.766800 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:43.810143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:43.859801 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:43.867906 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Deleted volume successfully.
Aug 06 21:08:43.890079 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e8e0d17e-37b7-4222-96df-194ffe8ae4fb tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-b158f367-0386-45c5-9634-fa98c720244b-delete_volume" released by "delete_volume" :: held 0.902s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:44.331650 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Acquiring lock "cinder-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:44.349896 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:44.435482 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:44.552641 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:44.553477 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Volume volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:08:44.573653 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] deleting rbd volume volume-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:45.213687 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Created reservations ['f199927a-4c8d-48b3-9907-efe9a251d70a', 'dfc01533-a4b3-4d57-8033-c21983c44123', '6a05f492-2cda-4f5d-9469-46895d5cc048', '0303d3c1-161c-4a25-b3b7-96501c85292c'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:45.347818 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:45.428797 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:45.518523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:45.523131 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Deleted volume successfully.
Aug 06 21:08:45.541203 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-335e309d-6ce3-4398-914a-bcc9c4b6e180 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-4b7c5ffc-6043-494a-9c0c-0d25f5a6c1e5-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:45.557357 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Acquiring lock "cinder-1c50e947-04ab-4f1c-af43-9bdf85fe71c4-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:08:45.572838 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-1c50e947-04ab-4f1c-af43-9bdf85fe71c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:08:45.614408 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:45.714879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:08:45.724855 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] deleting rbd volume volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:08:46.048054 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:08:46.082108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] deleting parent snapshot volume-1c50e947-04ab-4f1c-af43-9bdf85fe71c4.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:08:46.522102 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Created reservations ['c73389fe-c431-40b7-abd3-0cc1cbd61c5e', '6f97733b-4c56-41c8-8ee1-390e19e4a284', '42d51eda-2c3b-4d45-8ed5-55b88dc53c99', 'a950aaa8-ebfc-466c-a3e2-a98338667983'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:08:46.525235 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=35,cinder:SELECT=55,cinder:DELETE=4,cinder:INSERT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:08:46.619159 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:46.731417 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:08:46.783698 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:08:46.795170 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Deleted volume successfully.
Aug 06 21:08:46.812791 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-68e1850e-2ad9-41c9-8374-50a3eeb17244 tempest-TaggedBootDevicesTest-335631018 None] Lock "cinder-1c50e947-04ab-4f1c-af43-9bdf85fe71c4-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:08:56.803353 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=38,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:09:12.230239 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:09:12.985154 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 req-d0170081-a375-4e23-b563-cc0eab64d1c7 tempest-ServerRescueNegativeTestJSON-1101172257 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:09:14.692455 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 req-d0170081-a375-4e23-b563-cc0eab64d1c7 tempest-ServerRescueNegativeTestJSON-1101172257 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.710s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:09:14.694854 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 req-d0170081-a375-4e23-b563-cc0eab64d1c7 tempest-ServerRescueNegativeTestJSON-1101172257 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:09:14.746879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 req-d0170081-a375-4e23-b563-cc0eab64d1c7 tempest-ServerRescueNegativeTestJSON-1101172257 None] Connection info returned from driver {'name': 'volumes/volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9803bb6c-aba8-4d86-8dea-471fe31173b4'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:09:14.866898 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-9deeb5a6-e83e-4c23-a83e-0e549c4b4ae8 req-d0170081-a375-4e23-b563-cc0eab64d1c7 tempest-ServerRescueNegativeTestJSON-1101172257 None] attachment_update completed successfully.
Aug 06 21:09:20.709122 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:09:20.710046 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:09:20.778031 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:09:20.870340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:09:22.220223 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:09:37.884395 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-014738b9-2ac5-48cc-931e-dfa2e3b0a1cc tempest-ServersTestBootFromVolume-463747702 None] Terminate volume connection completed successfully.
Aug 06 21:09:37.885274 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-014738b9-2ac5-48cc-931e-dfa2e3b0a1cc tempest-ServersTestBootFromVolume-463747702 None] Deleting attachment 1a8e46c2-6e50-4a0d-9c3b-aeab44e5fe9a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:09:38.135647 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Acquiring lock "cinder-01cb2a8d-b4b3-4606-91b2-8f969ffe983b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:09:38.154972 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Lock "cinder-01cb2a8d-b4b3-4606-91b2-8f969ffe983b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:09:38.257610 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:09:38.402312 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:09:38.411561 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] deleting rbd volume volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:09:38.831565 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:09:38.882461 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] deleting parent snapshot volume-01cb2a8d-b4b3-4606-91b2-8f969ffe983b.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:09:39.602296 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Created reservations ['6f13b918-6672-48d0-9780-e2e965379454', 'd9955bac-11c1-4f44-aace-1e38b43fb897', '81a34cbf-feb9-4b56-99b4-3665723f66f8', 'fc619f79-9454-4cfa-b635-41aadb46cb33'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:09:39.705064 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:09:39.777500 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:09:39.854876 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:09:39.860779 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Deleted volume successfully.
Aug 06 21:09:39.891568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [req-d825d2a1-6721-42f0-b920-46680683d1a3 req-ca0d4da2-2653-4711-a89b-f318169c3a58 tempest-ServersTestBootFromVolume-463747702 None] Lock "cinder-01cb2a8d-b4b3-4606-91b2-8f969ffe983b-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:09:49.699202 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=17,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:09:52.238892 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=27,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:10:12.237898 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:10:20.706255 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:10:20.707084 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:20.765329 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:20.831761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:10:22.153400 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 req-e790b4a9-b0c4-44e2-b56c-0cdf71e83591 tempest-ServerRescueNegativeTestJSON-1101172257 None] Terminate volume connection completed successfully.
Aug 06 21:10:22.155952 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-c188b9c2-5425-4f0b-838b-3f88e04f93a0 req-e790b4a9-b0c4-44e2-b56c-0cdf71e83591 tempest-ServerRescueNegativeTestJSON-1101172257 None] Deleting attachment 9803bb6c-aba8-4d86-8dea-471fe31173b4. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:10:32.231838 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:10:39.650172 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Acquiring lock "cinder-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:10:39.707923 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Lock "cinder-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:10:39.846835 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:39.964704 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:10:39.966315 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:10:39.975148 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] deleting rbd volume volume-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:10:40.386427 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Created reservations ['30750822-17b5-4e35-86a0-c1e06f92aad2', '5b8811be-b318-44f6-bce7-68331d69bce3', '474e6c94-41b4-4ef3-81ae-b9f0ad3291a4', '66419734-f1c5-4220-8c4a-f7abe2c3bd41'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:10:40.463782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:40.527069 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:40.613208 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:10:40.619011 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Deleted volume successfully.
Aug 06 21:10:40.636807 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4a2d157-1a88-4891-be5c-6b31fd127965 tempest-ServerRescueNegativeTestJSON-1101172257 None] Lock "cinder-ca9b1ff3-14ac-45a1-a04c-6f7d2570e1d8-delete_volume" released by "delete_volume" :: held 0.942s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:10:41.091659 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Acquiring lock "cinder-05b97652-8690-49da-8129-7f7b2bc838b6-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:10:41.128629 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Lock "cinder-05b97652-8690-49da-8129-7f7b2bc838b6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:10:41.263722 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:41.339752 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:10:41.340431 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Volume volume-05b97652-8690-49da-8129-7f7b2bc838b6 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:10:41.348901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] deleting rbd volume volume-05b97652-8690-49da-8129-7f7b2bc838b6 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:10:41.814536 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Created reservations ['d00c00bc-4202-4f8e-8acc-5c669c07bda2', '378aaf5f-2452-43b5-aab4-0c230c44677d', '67f6819d-2007-4253-8ae9-f4690d4c2e97', '928476bb-2b07-4977-820f-504cf9b6135a'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:10:41.958134 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:42.052709 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:10:42.126071 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:10:42.130705 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Deleted volume successfully.
Aug 06 21:10:42.150046 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4fc94c0a-d6e5-4437-ab92-8e11aebd5362 tempest-ServerRescueNegativeTestJSON-1101172257 None] Lock "cinder-05b97652-8690-49da-8129-7f7b2bc838b6-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:10:52.227189 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=37,cinder:UPDATE=21,cinder:INSERT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:11:03.020907 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Acquiring lock "cinder-e6ea7076-822c-4b14-984a-9e1a1f380625-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:11:03.041568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Lock "cinder-e6ea7076-822c-4b14-984a-9e1a1f380625-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:11:03.052181 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=27,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:11:03.134971 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:03.191515 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:11:03.191961 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Volume volume-e6ea7076-822c-4b14-984a-9e1a1f380625 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:11:03.201093 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] deleting rbd volume volume-e6ea7076-822c-4b14-984a-9e1a1f380625 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:11:03.633356 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Created reservations ['9088bb23-1b1b-4328-a717-694e57dd47ea', 'c2785c4f-eb2d-4e4d-91ce-e5f658907bb3', '2b391667-0014-49a1-818c-251ea5f9011c', '20c26181-b682-4cac-ad62-6c0c5ebed871'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:11:03.733598 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:03.816444 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:03.878984 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:11:03.893816 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Deleted volume successfully.
Aug 06 21:11:03.930697 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e0b24c97-ffac-4ccc-8975-26b80afc1b48 tempest-DeleteServersTestJSON-1467588605 None] Lock "cinder-e6ea7076-822c-4b14-984a-9e1a1f380625-delete_volume" released by "delete_volume" :: held 0.889s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:11:20.708660 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:11:20.709328 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:20.789607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:20.890477 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:11:32.229101 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:11:40.289382 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=18,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:11:40.339209 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:11:40.399792 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (6e56cc45-fb52-4741-a368-09bf78264921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:11:40.411602 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9602536-c4e1-4c33-977a-b07d9f70cf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.484132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9602536-c4e1-4c33-977a-b07d9f70cf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-12620933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=da21e4cb-8f2e-4146-9204-b6a84bccd68b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4980bb21b59412ca004d8069525d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:11:40Z,use_quota=True,user_id='1d7b9e27983940dcaf0e92f62273c588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.497068 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a44a8e0-2d61-4bba-b550-bfdd0cbb1abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.509195 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a44a8e0-2d61-4bba-b550-bfdd0cbb1abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.525459 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b54a82-4b35-4072-8dc7-5bdecadd8401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.546770 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4b54a82-4b35-4072-8dc7-5bdecadd8401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'volume_name': 'volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.559197 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc73ad16-71bc-461b-9055-e2136fcc4cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.572886 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc73ad16-71bc-461b-9055-e2136fcc4cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.584875 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8f8fec-1869-4eb0-9879-ca3e7aa098ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.586814 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Volume da21e4cb-8f2e-4146-9204-b6a84bccd68b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'volume_size': 1}
Aug 06 21:11:40.587754 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] creating volume 'volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:11:40.589266 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:11:40.691643 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:11:40.692205 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:11:40.695774 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba8f8fec-1869-4eb0-9879-ca3e7aa098ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.700873 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd75650-e2b2-455a-a0fb-2cd0492afec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:11:40.724099 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b (da21e4cb-8f2e-4146-9204-b6a84bccd68b): created successfully
Aug 06 21:11:40.733424 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd75650-e2b2-455a-a0fb-2cd0492afec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:11:40.741818 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (6e56cc45-fb52-4741-a368-09bf78264921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:11:40.764178 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5b97bf95-dfd4-4836-989c-1f5d92d1c556 tempest-AttachVolumeNegativeTest-1196263590 None] Created volume successfully.
Aug 06 21:11:43.469493 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 req-815e9a22-7715-43cf-81cf-69d45b6d4937 tempest-AttachVolumeNegativeTest-1196263590 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:11:44.990566 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 req-815e9a22-7715-43cf-81cf-69d45b6d4937 tempest-AttachVolumeNegativeTest-1196263590 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.520s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:11:44.995032 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 req-815e9a22-7715-43cf-81cf-69d45b6d4937 tempest-AttachVolumeNegativeTest-1196263590 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:11:45.040296 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 req-815e9a22-7715-43cf-81cf-69d45b6d4937 tempest-AttachVolumeNegativeTest-1196263590 None] Connection info returned from driver {'name': 'volumes/volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'da21e4cb-8f2e-4146-9204-b6a84bccd68b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '20292f95-cb8e-4ca8-8496-cfaeb95a1986'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:11:45.184270 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d1d5570c-e8d9-4601-a4a8-c170e3e7d477 req-815e9a22-7715-43cf-81cf-69d45b6d4937 tempest-AttachVolumeNegativeTest-1196263590 None] attachment_update completed successfully.
Aug 06 21:12:02.232666 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=13,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:12:12.230653 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:12:20.710498 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:12:20.712421 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:12:20.828479 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:12:20.918995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:12:22.233775 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:12:32.240163 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:12:52.230321 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:13:00.699879 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-aea6d555-02cf-4470-8990-837add916c5b req-73afeadf-b2a0-4b76-9a74-d8ce5223797e tempest-AttachVolumeNegativeTest-1196263590 None] Terminate volume connection completed successfully.
Aug 06 21:13:00.700609 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-aea6d555-02cf-4470-8990-837add916c5b req-73afeadf-b2a0-4b76-9a74-d8ce5223797e tempest-AttachVolumeNegativeTest-1196263590 None] Deleting attachment 20292f95-cb8e-4ca8-8496-cfaeb95a1986. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:13:10.699867 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:13:20.716583 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:13:20.717281 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:13:20.798635 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:13:20.898975 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:13:32.226865 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:13:42.227747 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:13:46.344392 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:13:46.419569 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Flow 'volume_create_manager' (4f799a0d-12a9-4a3c-8ae5-7ffe4836ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:13:46.431395 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7494ff6e-4f04-4881-aa85-54e41f83af3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.481894 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7494ff6e-4f04-4881-aa85-54e41f83af3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:13:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-949965033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1a7d63a1a048df9cdf8e86a26b4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:13:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:13:46Z,use_quota=True,user_id='a6c953ff2f774041a7d50f53033ee124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.503878 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b90f1-bbdb-48c7-a783-606ea373c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.510274 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14b90f1-bbdb-48c7-a783-606ea373c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.517981 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99679cf9-5137-4f0f-9c6d-28f484e37887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.541088 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99679cf9-5137-4f0f-9c6d-28f484e37887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7', 'volume_name': 'volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.554086 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cdcdb7-9e51-485a-b4b7-861593272f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.559834 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03cdcdb7-9e51-485a-b4b7-861593272f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.583125 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5582d2-fcc1-4f7b-b3fd-82db75db28fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.584300 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Volume a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7', 'volume_size': 1}
Aug 06 21:13:46.585473 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] creating volume 'volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:13:46.586278 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:13:46.702673 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:13:46.703241 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:13:46.710026 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5582d2-fcc1-4f7b-b3fd-82db75db28fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.720073 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed739bb-f1df-46e2-8e9d-9a51e238985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:46.736267 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Volume volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 (a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7): created successfully
Aug 06 21:13:46.741892 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed739bb-f1df-46e2-8e9d-9a51e238985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:46.753551 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Flow 'volume_create_manager' (4f799a0d-12a9-4a3c-8ae5-7ffe4836ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:13:46.762822 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-72840c27-b262-4902-8927-2013df99eb47 tempest-ServersNegativeTestJSON-391655129 None] Created volume successfully.
Aug 06 21:13:49.354185 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:13:49.413358 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Flow 'volume_create_manager' (5cac1252-6647-4679-aef2-81513043c1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:13:49.421076 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40b202-9be1-4449-93ea-41725346a276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.440304 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40b202-9be1-4449-93ea-41725346a276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2146504975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=789975ac-83d5-4333-9996-bffa549e21f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1a7d63a1a048df9cdf8e86a26b4086',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:13:49Z,use_quota=True,user_id='a6c953ff2f774041a7d50f53033ee124',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.446917 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f4a6e7-a3c5-4fa3-9d56-e5ee6bb76487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.451922 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f4a6e7-a3c5-4fa3-9d56-e5ee6bb76487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.457568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a71927a-de14-4bca-856f-6ac23e5cea76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.462811 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a71927a-de14-4bca-856f-6ac23e5cea76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '789975ac-83d5-4333-9996-bffa549e21f9', 'volume_name': 'volume-789975ac-83d5-4333-9996-bffa549e21f9', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.467993 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efed59aa-2042-4734-bdfe-aa1ee9dc1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.472561 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efed59aa-2042-4734-bdfe-aa1ee9dc1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.477764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c59eb09-3eed-4b4b-864b-b14d5cd1a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.478892 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Volume 789975ac-83d5-4333-9996-bffa549e21f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-789975ac-83d5-4333-9996-bffa549e21f9', 'volume_size': 1}
Aug 06 21:13:49.479289 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] creating volume 'volume-789975ac-83d5-4333-9996-bffa549e21f9' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:13:49.480058 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:13:49.574966 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:13:49.575328 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:13:49.579918 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c59eb09-3eed-4b4b-864b-b14d5cd1a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-789975ac-83d5-4333-9996-bffa549e21f9', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.589066 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3017f8b-f05b-4a2f-b46e-44115ee0cc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:13:49.612314 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Volume volume-789975ac-83d5-4333-9996-bffa549e21f9 (789975ac-83d5-4333-9996-bffa549e21f9): created successfully
Aug 06 21:13:49.616174 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3017f8b-f05b-4a2f-b46e-44115ee0cc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:13:49.621978 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Flow 'volume_create_manager' (5cac1252-6647-4679-aef2-81513043c1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:13:49.644138 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-912aad07-8a65-4ea2-97c0-b34bc9ebd018 tempest-ServersNegativeTestJSON-391655129 None] Created volume successfully.
Aug 06 21:13:57.220256 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4c143fdd-d370-4980-914d-a3cb875b05c5 tempest-GroupsTest-226620639 None] Group tempest-Group1-414645261: creating
Aug 06 21:13:57.272429 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4c143fdd-d370-4980-914d-a3cb875b05c5 tempest-GroupsTest-226620639 None] Group tempest-Group1-414645261: created successfully
Aug 06 21:13:57.285138 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4c143fdd-d370-4980-914d-a3cb875b05c5 tempest-GroupsTest-226620639 None] Create group completed successfully.
Aug 06 21:13:58.781991 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-55fe7118-88aa-4823-9f97-e0f79a6206ae tempest-GroupsTest-226620639 None] Group tempest-Group2-1906216958: creating
Aug 06 21:13:58.824654 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-55fe7118-88aa-4823-9f97-e0f79a6206ae tempest-GroupsTest-226620639 None] Group tempest-Group2-1906216958: created successfully
Aug 06 21:13:58.842075 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-55fe7118-88aa-4823-9f97-e0f79a6206ae tempest-GroupsTest-226620639 None] Create group completed successfully.
Aug 06 21:14:00.721873 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:00.770742 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (ad2a18cc-8d76-4b4f-837d-5bfdb9873fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:00.785087 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cec6f-f404-4de6-8fb6-a93fd706ab9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:00.825425 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499cec6f-f404-4de6-8fb6-a93fd706ab9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-65320129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4131511e-ee71-4b1a-9e8f-2f072120fa66,host='ncdv-master-1@ceph#ceph',id=4b0c9552-3e45-410b-9f90-9c619378da9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dc126a193b46a293d46c21b28f4861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:01Z,use_quota=True,user_id='e969b90e30424b1795008ba4d1c99883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f24d176d-6e84-4b3a-9bff-e014c05d2f2c),volume_type_id=f24d176d-6e84-4b3a-9bff-e014c05d2f2c)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:00.835842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41568e69-86ee-4e0f-951f-95221ef3bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:00.840425 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41568e69-86ee-4e0f-951f-95221ef3bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:00.857635 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92605060-3ffe-4199-9e3b-15467f97bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:00.864875 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92605060-3ffe-4199-9e3b-15467f97bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b0c9552-3e45-410b-9f90-9c619378da9f', 'volume_name': 'volume-4b0c9552-3e45-410b-9f90-9c619378da9f', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:00.872840 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3e76a8-2361-49d3-9827-63d1548fa472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:00.885556 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3e76a8-2361-49d3-9827-63d1548fa472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:00.893866 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bcc081-55ce-4c00-988a-b305b1eb724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:00.896140 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Volume 4b0c9552-3e45-410b-9f90-9c619378da9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b0c9552-3e45-410b-9f90-9c619378da9f', 'volume_size': 1}
Aug 06 21:14:00.898098 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] creating volume 'volume-4b0c9552-3e45-410b-9f90-9c619378da9f' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:00.899185 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:01.033587 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:01.034298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:01.040523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bcc081-55ce-4c00-988a-b305b1eb724f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b0c9552-3e45-410b-9f90-9c619378da9f', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:01.047067 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111bfc1b-7fa4-4739-abd0-95125b8cf0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:01.070288 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Volume volume-4b0c9552-3e45-410b-9f90-9c619378da9f (4b0c9552-3e45-410b-9f90-9c619378da9f): created successfully
Aug 06 21:14:01.085614 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111bfc1b-7fa4-4739-abd0-95125b8cf0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:01.102757 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (ad2a18cc-8d76-4b4f-837d-5bfdb9873fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:01.133199 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c4ead16e-61ce-4bd2-86cc-14432c590583 tempest-GroupsTest-226620639 None] Created volume successfully.
Aug 06 21:14:02.930063 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:02.966755 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:03.066857 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:03.071285 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Volume volume-4b0c9552-3e45-410b-9f90-9c619378da9f is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:03.082484 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] deleting rbd volume volume-4b0c9552-3e45-410b-9f90-9c619378da9f {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:03.543538 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Created reservations ['f70d1714-5f8d-4b3d-a3ae-ada4b711fee7'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:03.591373 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2080966870 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2080966870, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:14:03.593603 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2080966870 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2080966870, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:14:03.632953 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Created reservations ['1ec2602c-5306-4d93-a7a9-190ebc6d70da', 'd1492513-9539-42aa-831d-ffe61934a023', 'bfc2ea57-9a5b-41fe-9c1c-81b04599d5dd', '25fbde95-2a8d-4a83-bf04-8bf619c25884'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:03.848896 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:03.968899 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:04.035261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:04.046671 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-19c65721-4db8-40ba-89d6-9508429aefe9 tempest-GroupsTest-226620639 None] Delete group completed successfully.
Aug 06 21:14:04.621552 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-c86ef625-3220-42a7-b1a4-39d229bb8aec tempest-GroupsTest-226620639 None] Created reservations ['0895f572-267a-43bf-b025-5420bd21e445'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:04.736132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c86ef625-3220-42a7-b1a4-39d229bb8aec tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:04.822910 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c86ef625-3220-42a7-b1a4-39d229bb8aec tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:04.917318 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-c86ef625-3220-42a7-b1a4-39d229bb8aec tempest-GroupsTest-226620639 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:04.928133 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c86ef625-3220-42a7-b1a4-39d229bb8aec tempest-GroupsTest-226620639 None] Delete group completed successfully.
Aug 06 21:14:06.572206 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7727e369-e78d-47a0-87e7-e0637c81966d tempest-GroupsTest-226620639 None] Group tempest-GroupsTest-Group-698163543: creating
Aug 06 21:14:06.631941 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7727e369-e78d-47a0-87e7-e0637c81966d tempest-GroupsTest-226620639 None] Group tempest-GroupsTest-Group-698163543: created successfully
Aug 06 21:14:06.683560 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7727e369-e78d-47a0-87e7-e0637c81966d tempest-GroupsTest-226620639 None] Create group completed successfully.
Aug 06 21:14:08.852057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:08.881532 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (af8644f4-28d4-4036-a578-74360ef34ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:08.893295 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1079a5f-a033-4f11-9d86-d55b779c900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:08.932557 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1079a5f-a033-4f11-9d86-d55b779c900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-164467196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=837e2ff6-e1b9-40d3-b6c8-f7b3ebf516f3,host='ncdv-master-1@ceph#ceph',id=9c997b96-b8e8-4c77-8985-5d4a54757a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dc126a193b46a293d46c21b28f4861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:09Z,use_quota=True,user_id='e969b90e30424b1795008ba4d1c99883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2444c002-cf53-49d5-9080-49ea592479c4),volume_type_id=2444c002-cf53-49d5-9080-49ea592479c4)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:08.950894 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecbc14b-e483-4d98-9366-494ef2f2cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:08.958257 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cecbc14b-e483-4d98-9366-494ef2f2cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:08.964142 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1630a1-2e4d-4c42-a7d9-ea9343559763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:08.970480 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1630a1-2e4d-4c42-a7d9-ea9343559763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c997b96-b8e8-4c77-8985-5d4a54757a60', 'volume_name': 'volume-9c997b96-b8e8-4c77-8985-5d4a54757a60', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:09.014636 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b946e2c-6089-4ecc-8feb-b188cb7b6451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:09.022029 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b946e2c-6089-4ecc-8feb-b188cb7b6451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:09.027041 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f570fc1-c9a7-4383-b282-e7694a43283b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:09.028869 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Volume 9c997b96-b8e8-4c77-8985-5d4a54757a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c997b96-b8e8-4c77-8985-5d4a54757a60', 'volume_size': 1}
Aug 06 21:14:09.029682 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] creating volume 'volume-9c997b96-b8e8-4c77-8985-5d4a54757a60' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:09.030768 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:09.158515 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:09.159355 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:09.163617 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f570fc1-c9a7-4383-b282-e7694a43283b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c997b96-b8e8-4c77-8985-5d4a54757a60', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:09.174440 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd957698-8e66-41c0-a8bb-073e6f2417a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:09.199762 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Volume volume-9c997b96-b8e8-4c77-8985-5d4a54757a60 (9c997b96-b8e8-4c77-8985-5d4a54757a60): created successfully
Aug 06 21:14:09.204651 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd957698-8e66-41c0-a8bb-073e6f2417a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:09.218451 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (af8644f4-28d4-4036-a578-74360ef34ddc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:09.252629 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-62f81a4d-0841-4bd1-93ea-8797b6390aad tempest-GroupsTest-226620639 None] Created volume successfully.
Aug 06 21:14:10.922158 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:10.973604 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (e0637b76-0d34-4ef8-951c-c6b3e4d5ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:10.987901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f051877a-1ed1-4f49-8939-d7037b39d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.016748 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f051877a-1ed1-4f49-8939-d7037b39d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-1596245607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=837e2ff6-e1b9-40d3-b6c8-f7b3ebf516f3,host='ncdv-master-1@ceph#ceph',id=e5887c14-20c5-49be-8e6b-580af7e6fe44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dc126a193b46a293d46c21b28f4861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:11Z,use_quota=True,user_id='e969b90e30424b1795008ba4d1c99883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2444c002-cf53-49d5-9080-49ea592479c4),volume_type_id=2444c002-cf53-49d5-9080-49ea592479c4)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.023638 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567c5df7-0798-4bf6-9704-195c47590c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.028711 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (567c5df7-0798-4bf6-9704-195c47590c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.055690 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdf8a40-cb8c-4cd4-b875-d87ca46f9f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.073071 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdf8a40-cb8c-4cd4-b875-d87ca46f9f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5887c14-20c5-49be-8e6b-580af7e6fe44', 'volume_name': 'volume-e5887c14-20c5-49be-8e6b-580af7e6fe44', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.079780 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430b75e-c1b2-41b0-9e3a-77185f12fb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.086519 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c430b75e-c1b2-41b0-9e3a-77185f12fb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.093976 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86ee68c-9d5d-440c-940f-b4f36bcf5070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.095483 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Volume e5887c14-20c5-49be-8e6b-580af7e6fe44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5887c14-20c5-49be-8e6b-580af7e6fe44', 'volume_size': 1}
Aug 06 21:14:11.095991 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] creating volume 'volume-e5887c14-20c5-49be-8e6b-580af7e6fe44' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:11.096794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:11.185340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:11.224740 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Flow 'volume_create_manager' (f683f89e-87e8-4dbb-a578-59053daa971a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:11.235586 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfdcf0c-2d46-4066-9175-bd4b63f8a2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.246786 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:11.247278 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:11.252888 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e86ee68c-9d5d-440c-940f-b4f36bcf5070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5887c14-20c5-49be-8e6b-580af7e6fe44', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.258831 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fead89-93d6-41b3-93a0-ff890615a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.277358 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Volume volume-e5887c14-20c5-49be-8e6b-580af7e6fe44 (e5887c14-20c5-49be-8e6b-580af7e6fe44): created successfully
Aug 06 21:14:11.282103 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fead89-93d6-41b3-93a0-ff890615a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.293032 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Flow 'volume_create_manager' (e0637b76-0d34-4ef8-951c-c6b3e4d5ef23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:11.312072 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cfdcf0c-2d46-4066-9175-bd4b63f8a2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-733956522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=406548bb-74e3-4189-bcbb-dcba6fc6c3b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ad47787f3945178942cbe781b82021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:11Z,use_quota=True,user_id='c43b09f788b143ad91d1ffe2621daae7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.320189 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e519e6-6515-48e3-ac7d-37aa2a5e1719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.326933 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e519e6-6515-48e3-ac7d-37aa2a5e1719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.338081 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17939cb3-7bf8-4eb8-9004-0540d7a8ab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.343381 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17939cb3-7bf8-4eb8-9004-0540d7a8ab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406548bb-74e3-4189-bcbb-dcba6fc6c3b0', 'volume_name': 'volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.349761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe904e-c44c-4b5b-b22a-c4e8847ac480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.354252 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eebe904e-c44c-4b5b-b22a-c4e8847ac480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.364449 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f8fb48-5afb-4e03-8463-2f4acd84ffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.366365 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Volume 406548bb-74e3-4189-bcbb-dcba6fc6c3b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0', 'volume_size': 1}
Aug 06 21:14:11.366822 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] creating volume 'volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:11.367748 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:11.433182 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-df56b5ec-700e-4a85-91f6-e0efc7160d08 tempest-GroupsTest-226620639 None] Created volume successfully.
Aug 06 21:14:11.512989 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:11.513550 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:11.517530 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64f8fb48-5afb-4e03-8463-2f4acd84ffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.527677 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e08434-f7cf-4dcb-ba44-ba8d42ae4a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:11.548449 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Volume volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0 (406548bb-74e3-4189-bcbb-dcba6fc6c3b0): created successfully
Aug 06 21:14:11.559055 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e08434-f7cf-4dcb-ba44-ba8d42ae4a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:11.585245 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Flow 'volume_create_manager' (f683f89e-87e8-4dbb-a578-59053daa971a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:11.607484 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5bc19b45-9c63-4cda-beeb-8353177fae09 tempest-VolumesServicesTestJSON-970155057 None] Created volume successfully.
Aug 06 21:14:12.258231 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=61,cinder:UPDATE=28,cinder:DELETE=4,cinder:INSERT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:12.267438 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Acquiring lock "cinder-406548bb-74e3-4189-bcbb-dcba6fc6c3b0-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:12.331807 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-479da89c-7665-45cd-9ce9-9fd340630d54 tempest-GroupsTest-226620639 None] Update group completed successfully.
Aug 06 21:14:12.340188 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Lock "cinder-406548bb-74e3-4189-bcbb-dcba6fc6c3b0-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:12.406858 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:12.513000 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:12.513794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Volume volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:12.527777 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] deleting rbd volume volume-406548bb-74e3-4189-bcbb-dcba6fc6c3b0 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:12.917765 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=74,cinder:INSERT=3,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:12.948085 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Created reservations ['bd4e54eb-af0f-41a9-b938-0ddccb676823', '253c8469-37fe-44a0-a14c-d857be1e1d72', 'dcf2b07d-d7f3-47f4-b49f-0e8ed1eaabc4', 'bb4bf428-b45c-419b-8a16-b8017b2fc301'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:13.044314 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:13.118873 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:13.182146 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:13.191734 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Deleted volume successfully.
Aug 06 21:14:13.249132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-80ec5e42-af90-406b-bc9c-f2d1c2a928f5 tempest-VolumesServicesTestJSON-970155057 None] Lock "cinder-406548bb-74e3-4189-bcbb-dcba6fc6c3b0-delete_volume" released by "delete_volume" :: held 0.909s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:14.050139 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-da22583a-c263-4c62-834b-0efba50bc78f tempest-GroupsTest-226620639 None] Update group completed successfully.
Aug 06 21:14:15.805394 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:15.919189 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:15.919957 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Volume volume-9c997b96-b8e8-4c77-8985-5d4a54757a60 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:15.934808 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] deleting rbd volume volume-9c997b96-b8e8-4c77-8985-5d4a54757a60 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:16.270212 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:16.339516 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:16.342782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Volume volume-e5887c14-20c5-49be-8e6b-580af7e6fe44 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:16.353336 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] deleting rbd volume volume-e5887c14-20c5-49be-8e6b-580af7e6fe44 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:16.855633 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Created reservations ['1c45b56d-9b9c-4367-b0b8-ad1e9cff9c89'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:16.881002 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1633567852 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1633567852, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:14:16.897306 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1633567852 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1633567852, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:14:16.941559 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Created reservations ['81b236f6-c34d-46d3-b8f2-f3491f963bdf', '60657ef4-6bce-4a28-8b47-d334993f312c', 'f3bbe45a-f52b-423f-bff7-5d5f434a4ea5', 'c92a9b6e-53d6-4222-89eb-374dcb337579'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:17.135255 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Created reservations ['9da39cee-008c-4f3b-a7b4-9d2490d7b660', '99f55374-078d-45bc-ad47-ab2b214d0fa5', 'f118751c-d255-4195-9145-7ff1c2a040b1', 'b52227e8-60a5-4515-889a-9562af5ea549'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:17.345173 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:17.459643 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:17.590300 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:17.596427 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5628cb3f-233e-4fd4-bd16-2926c7b6c79d tempest-GroupsTest-226620639 None] Delete group completed successfully.
Aug 06 21:14:20.714004 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:14:20.715450 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:20.792563 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:20.870114 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:24.792117 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:24.876336 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (6d5be5ca-6e43-4c11-86be-e0d9fe600d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:24.898429 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac002cb9-81f4-411c-8c96-96ab658d7cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:24.960486 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac002cb9-81f4-411c-8c96-96ab658d7cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1145929805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce9057e2-c953-4b6c-ab01-a1beb7796115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4980bb21b59412ca004d8069525d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:25Z,use_quota=True,user_id='1d7b9e27983940dcaf0e92f62273c588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:24.986584 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d16111-2303-4cf2-bf5c-b98ad7ad5625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:25.014982 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d16111-2303-4cf2-bf5c-b98ad7ad5625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:25.038616 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f83f133-a038-4e43-952d-c5e8791ee2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:25.042817 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f83f133-a038-4e43-952d-c5e8791ee2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9057e2-c953-4b6c-ab01-a1beb7796115', 'volume_name': 'volume-ce9057e2-c953-4b6c-ab01-a1beb7796115', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:25.084750 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3e519-9400-46ae-8671-44c4636f60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:25.089057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3e519-9400-46ae-8671-44c4636f60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:25.097465 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c75a0d-3bdb-43f4-acfe-afa818f31e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:25.099454 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Volume ce9057e2-c953-4b6c-ab01-a1beb7796115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9057e2-c953-4b6c-ab01-a1beb7796115', 'volume_size': 1}
Aug 06 21:14:25.100039 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] creating volume 'volume-ce9057e2-c953-4b6c-ab01-a1beb7796115' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:25.101009 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:25.214287 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:25.214941 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:25.219110 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c75a0d-3bdb-43f4-acfe-afa818f31e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9057e2-c953-4b6c-ab01-a1beb7796115', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:25.232167 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d15a4e-9800-483e-9e25-3ad80f5c4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:25.256999 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-ce9057e2-c953-4b6c-ab01-a1beb7796115 (ce9057e2-c953-4b6c-ab01-a1beb7796115): created successfully
Aug 06 21:14:25.263674 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d15a4e-9800-483e-9e25-3ad80f5c4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:25.275775 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (6d5be5ca-6e43-4c11-86be-e0d9fe600d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:25.297542 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5dabb530-c808-45f2-9e61-eaf91a60ef1a tempest-AttachVolumeNegativeTest-1196263590 None] Created volume successfully.
Aug 06 21:14:26.952769 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-b81c5333-f008-4583-82c7-c840c0efc2d1 req-ded3defb-2ec4-4242-b60c-b777af807664 tempest-AttachVolumeNegativeTest-1196263590 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:14:28.355462 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-b81c5333-f008-4583-82c7-c840c0efc2d1 req-ded3defb-2ec4-4242-b60c-b777af807664 tempest-AttachVolumeNegativeTest-1196263590 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.400s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:14:28.356298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-b81c5333-f008-4583-82c7-c840c0efc2d1 req-ded3defb-2ec4-4242-b60c-b777af807664 tempest-AttachVolumeNegativeTest-1196263590 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce9057e2-c953-4b6c-ab01-a1beb7796115', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'ce9057e2-c953-4b6c-ab01-a1beb7796115', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:14:28.398866 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-b81c5333-f008-4583-82c7-c840c0efc2d1 req-ded3defb-2ec4-4242-b60c-b777af807664 tempest-AttachVolumeNegativeTest-1196263590 None] Connection info returned from driver {'name': 'volumes/volume-ce9057e2-c953-4b6c-ab01-a1beb7796115', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce9057e2-c953-4b6c-ab01-a1beb7796115', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '57ed8c73-cb49-4830-92b7-453d3a975a9a'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:14:28.498954 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-b81c5333-f008-4583-82c7-c840c0efc2d1 req-ded3defb-2ec4-4242-b60c-b777af807664 tempest-AttachVolumeNegativeTest-1196263590 None] attachment_update completed successfully.
Aug 06 21:14:32.058945 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-02412645-d158-41db-ae44-f2964cf68fbc req-e964ee7d-1d73-451f-ba83-af800bb09ede tempest-AttachVolumeNegativeTest-1196263590 None] Terminate volume connection completed successfully.
Aug 06 21:14:32.060879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-02412645-d158-41db-ae44-f2964cf68fbc req-e964ee7d-1d73-451f-ba83-af800bb09ede tempest-AttachVolumeNegativeTest-1196263590 None] Deleting attachment 57ed8c73-cb49-4830-92b7-453d3a975a9a. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:14:42.052818 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=57,cinder:INSERT=10,cinder:UPDATE=32 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:43.845507 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:43.880163 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Flow 'volume_create_manager' (dbbdc331-f3e3-4fed-bcd3-ecdef0b3ee17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:43.888978 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2856f8b5-9c50-42ac-aa5d-8a07bcc3dc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:43.919321 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2856f8b5-9c50-42ac-aa5d-8a07bcc3dc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1308055406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=18b81078-1bd8-4971-96f8-0774de385877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8e9314f6344143b71e436bc1d60fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:44Z,use_quota=True,user_id='6610b2fb1c9d4f7db384ade4bc27df4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:43.932155 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d0df92-fc16-41e3-8d16-84cfc65e9ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:43.940370 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d0df92-fc16-41e3-8d16-84cfc65e9ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:43.955567 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563ca908-6578-4858-9fab-e17190d0ebe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:43.972877 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563ca908-6578-4858-9fab-e17190d0ebe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b81078-1bd8-4971-96f8-0774de385877', 'volume_name': 'volume-18b81078-1bd8-4971-96f8-0774de385877', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:43.987144 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01c0b2-edac-4a8a-a91f-4dfa2c747c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:44.005081 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc01c0b2-edac-4a8a-a91f-4dfa2c747c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:44.022250 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df918cac-0bf8-4de4-8bf3-723ca7551189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:44.028601 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume 18b81078-1bd8-4971-96f8-0774de385877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b81078-1bd8-4971-96f8-0774de385877', 'volume_size': 1}
Aug 06 21:14:44.029940 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] creating volume 'volume-18b81078-1bd8-4971-96f8-0774de385877' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:44.032068 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:44.157915 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:44.158363 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:44.163412 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df918cac-0bf8-4de4-8bf3-723ca7551189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b81078-1bd8-4971-96f8-0774de385877', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:44.177156 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84ccb34-0bbd-426b-a6e0-7f46aaa5b48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:44.191948 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=32,cinder:SELECT=62,cinder:DELETE=2,cinder:INSERT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:44.203112 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume volume-18b81078-1bd8-4971-96f8-0774de385877 (18b81078-1bd8-4971-96f8-0774de385877): created successfully
Aug 06 21:14:44.215571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84ccb34-0bbd-426b-a6e0-7f46aaa5b48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:44.231033 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Flow 'volume_create_manager' (dbbdc331-f3e3-4fed-bcd3-ecdef0b3ee17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:44.257771 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-a581fc24-d529-4a01-bcc7-6afe390815a0 tempest-VolumeQuotasAdminTestJSON-674943726 None] Created volume successfully.
Aug 06 21:14:45.156796 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Acquiring lock "cinder-18b81078-1bd8-4971-96f8-0774de385877-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:45.181206 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Lock "cinder-18b81078-1bd8-4971-96f8-0774de385877-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:45.289866 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:45.420064 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:45.424496 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume volume-18b81078-1bd8-4971-96f8-0774de385877 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:45.442826 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] deleting rbd volume volume-18b81078-1bd8-4971-96f8-0774de385877 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:45.604243 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:45.633654 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Flow 'volume_create_manager' (0250c75a-b218-45ce-ac77-c72665956ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:45.704367 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749edc19-a471-464c-b81c-f1a2b02dddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:45.777065 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (749edc19-a471-464c-b81c-f1a2b02dddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2107656344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d9211dad-c088-4c51-bb35-06360eca52be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e617708266ab45c4882ecc85ec96895a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:45Z,use_quota=True,user_id='5e6391f307af40ed935dcbb8fc1ac4c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:45.792009 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8acc1d9-aa06-4905-9f5a-eda5063c77f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:45.804889 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8acc1d9-aa06-4905-9f5a-eda5063c77f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:45.819580 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa26a18-0c33-4361-9053-b56f89f33db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:45.829788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa26a18-0c33-4361-9053-b56f89f33db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9211dad-c088-4c51-bb35-06360eca52be', 'volume_name': 'volume-d9211dad-c088-4c51-bb35-06360eca52be', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:45.844728 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b645f6c9-2449-40bb-847e-86260182e77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:45.857746 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b645f6c9-2449-40bb-847e-86260182e77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:45.867505 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af0e0a1-26ed-42f6-a572-23e0bd7acde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:45.871914 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Volume d9211dad-c088-4c51-bb35-06360eca52be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9211dad-c088-4c51-bb35-06360eca52be', 'volume_size': 1}
Aug 06 21:14:45.872313 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] creating volume 'volume-d9211dad-c088-4c51-bb35-06360eca52be' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:45.872966 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:46.083231 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:46.083702 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:46.089780 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0af0e0a1-26ed-42f6-a572-23e0bd7acde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9211dad-c088-4c51-bb35-06360eca52be', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:46.101034 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de2a370-7981-49ae-85be-ae0e77beb1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:46.163218 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Volume volume-d9211dad-c088-4c51-bb35-06360eca52be (d9211dad-c088-4c51-bb35-06360eca52be): created successfully
Aug 06 21:14:46.173033 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de2a370-7981-49ae-85be-ae0e77beb1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:46.179595 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Flow 'volume_create_manager' (0250c75a-b218-45ce-ac77-c72665956ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:46.208630 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-88225874-9702-42b1-a0f3-1b92286c3b3e tempest-VolumesSnapshotListTestJSON-2020555594 None] Created volume successfully.
Aug 06 21:14:46.247692 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Created reservations ['f434a7d4-22b8-4795-90d6-12113ef77fbe', '69ca4ec2-f4f3-4687-a0f1-c4c96df492c8', '623d579c-6977-4625-8fa7-9abe554dddfa', '94d17af4-1d43-4186-847f-019130b1760c'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:46.370385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:46.442063 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:46.553851 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:46.563036 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Deleted volume successfully.
Aug 06 21:14:46.581787 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7860289-dd52-4236-956d-569f6d04e126 tempest-VolumeQuotasAdminTestJSON-674943726 None] Lock "cinder-18b81078-1bd8-4971-96f8-0774de385877-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:47.133994 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c3e2943b-08c8-4ca2-b478-569c1b925828 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:47.425785 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:14:47.480837 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Flow 'volume_create_manager' (1cbaeeb2-411f-47a5-9eb0-92ee3367f58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:47.493241 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ab5be2-e52f-45ba-9b6d-111c5f1ffa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.532845 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46ab5be2-e52f-45ba-9b6d-111c5f1ffa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-243298443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be47a184-3194-4a4d-8cbd-dd88fab0346a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8e9314f6344143b71e436bc1d60fee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:14:47Z,use_quota=True,user_id='6610b2fb1c9d4f7db384ade4bc27df4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.568769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af28f2b6-1202-4b70-b556-d76493784a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.579604 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af28f2b6-1202-4b70-b556-d76493784a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.609691 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00bb8ea-ed5d-4a4a-89c8-0c817e261a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.614237 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00bb8ea-ed5d-4a4a-89c8-0c817e261a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be47a184-3194-4a4d-8cbd-dd88fab0346a', 'volume_name': 'volume-be47a184-3194-4a4d-8cbd-dd88fab0346a', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.619639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed672df-fd69-4e2e-8b83-094a8959835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.623637 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed672df-fd69-4e2e-8b83-094a8959835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.629622 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e53741-5106-40ab-9620-f87ae4162313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.630775 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume be47a184-3194-4a4d-8cbd-dd88fab0346a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be47a184-3194-4a4d-8cbd-dd88fab0346a', 'volume_size': 1}
Aug 06 21:14:47.631257 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] creating volume 'volume-be47a184-3194-4a4d-8cbd-dd88fab0346a' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:14:47.632118 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:47.761207 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:14:47.761856 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:14:47.766491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8e53741-5106-40ab-9620-f87ae4162313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be47a184-3194-4a4d-8cbd-dd88fab0346a', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.773743 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bdb10a-e4e2-4bf6-8abf-5e89135432b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:14:47.797450 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Volume volume-be47a184-3194-4a4d-8cbd-dd88fab0346a (be47a184-3194-4a4d-8cbd-dd88fab0346a): created successfully
Aug 06 21:14:47.804074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bdb10a-e4e2-4bf6-8abf-5e89135432b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:14:47.815741 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Flow 'volume_create_manager' (1cbaeeb2-411f-47a5-9eb0-92ee3367f58b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:14:47.840425 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-a20080bb-1351-44ea-889f-71d238b69a46 tempest-VolumeQuotasAdminTestJSON-674943726 None] Created volume successfully.
Aug 06 21:14:48.350523 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c3e2943b-08c8-4ca2-b478-569c1b925828 tempest-VolumesSnapshotListTestJSON-2020555594 None] Create snapshot completed successfully
Aug 06 21:14:49.714689 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-04ee3862-15c5-4c3f-a900-a9d13c7b9ab3 tempest-VolumeQuotasAdminTestJSON-1537187214 None] Transfer volume completed successfully.
Aug 06 21:14:49.855399 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-54c61453-34ca-41c6-af3c-d9b902a97cd4 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:50.375590 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-54c61453-34ca-41c6-af3c-d9b902a97cd4 tempest-VolumesSnapshotListTestJSON-2020555594 None] Create snapshot completed successfully
Aug 06 21:14:50.582834 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Acquiring lock "cinder-be47a184-3194-4a4d-8cbd-dd88fab0346a-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:50.603707 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Lock "cinder-be47a184-3194-4a4d-8cbd-dd88fab0346a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:50.644720 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:50.786729 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:14:50.787431 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Volume volume-be47a184-3194-4a4d-8cbd-dd88fab0346a is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:14:50.800739 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] deleting rbd volume volume-be47a184-3194-4a4d-8cbd-dd88fab0346a {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:14:51.266271 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Created reservations ['15ea429d-1b9c-458a-bf51-68c086a01e16', '360aebee-705f-4543-a23a-9c53ea4ad3fe', '29f41934-26a9-4346-951a-86aa7f581b4a', '2db45984-fc8f-4faf-b137-06809034d28d'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:51.299646 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9fc11474-a38d-4449-b4b8-b8c697b2050c tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:51.530015 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:51.589457 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:51.654208 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:14:51.658491 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Deleted volume successfully.
Aug 06 21:14:51.674028 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d54c7d56-bf35-4e4b-a705-74768ca4ea80 tempest-VolumeQuotasAdminTestJSON-1205976259 None] Lock "cinder-be47a184-3194-4a4d-8cbd-dd88fab0346a-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:52.411022 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9fc11474-a38d-4449-b4b8-b8c697b2050c tempest-VolumesSnapshotListTestJSON-2020555594 None] Create snapshot completed successfully
Aug 06 21:14:54.970933 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Acquiring lock "cinder-fb0bd50d-9de3-410a-94dd-2ee712b9b967-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:54.989438 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-fb0bd50d-9de3-410a-94dd-2ee712b9b967-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:54.990897 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:55.518019 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:14:55.556664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Created reservations ['524dc243-a52e-479c-93b9-57b5ce58ead9', 'b96c7b24-8dd1-497c-9d03-c61a87f45f6e', '7c37e40e-4eaa-44b7-b229-4f88afbcd8d7', 'b12df26a-40fa-4aaf-a08a-6e93652c7121'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:55.637214 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=66,cinder:UPDATE=25,cinder:DELETE=6,cinder:INSERT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:55.653746 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Delete snapshot completed successfully.
Aug 06 21:14:55.663607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-abe86e90-c5cd-4f48-a48d-c5a0ad9b0398 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-fb0bd50d-9de3-410a-94dd-2ee712b9b967-delete_snapshot" released by "delete_snapshot" :: held 0.674s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:56.147654 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] Acquiring lock "cinder-62fbef97-449d-4d4b-b8da-2db907eaacc2-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:56.165619 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-62fbef97-449d-4d4b-b8da-2db907eaacc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:56.170109 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:56.538488 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=56,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:14:56.616070 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] Created reservations ['91e53e50-5fab-4bfb-bafb-66fbf7bb6e7d', 'bc3fee33-71b2-4347-a308-7ffe912048ce', '4ab14fdb-3035-4612-80f0-1d0a7b597c78', '49b9c478-6ea9-47f6-8b64-fd2a9fd05689'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:56.731814 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] Delete snapshot completed successfully.
Aug 06 21:14:56.740770 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ca47829f-2da8-4fc0-880e-f44f4a2d21a1 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-62fbef97-449d-4d4b-b8da-2db907eaacc2-delete_snapshot" released by "delete_snapshot" :: held 0.574s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:57.389817 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] Acquiring lock "cinder-07127937-9ed4-4a8c-8bb4-386d5a751b11-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:57.466834 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-07127937-9ed4-4a8c-8bb4-386d5a751b11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:57.485500 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:14:58.623885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] Created reservations ['36fc1e53-5ee6-446d-a8ec-1f4f1cc65b8b', 'af2c56a5-441a-4912-a513-210b004d55bc', 'aac38d3d-05d6-4acc-a1e8-a1a7fc891b24', '415e44cf-36cb-44c8-89a9-0eff8d971ac1'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:14:58.748965 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] Delete snapshot completed successfully.
Aug 06 21:14:58.755343 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-01ab9821-1151-46a7-9d44-e8f7fc369100 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-07127937-9ed4-4a8c-8bb4-386d5a751b11-delete_snapshot" released by "delete_snapshot" :: held 1.294s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:14:59.813360 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Acquiring lock "cinder-d9211dad-c088-4c51-bb35-06360eca52be-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:14:59.846638 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-d9211dad-c088-4c51-bb35-06360eca52be-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:14:59.973389 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:00.121971 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:15:00.122398 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Volume volume-d9211dad-c088-4c51-bb35-06360eca52be is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:15:00.139821 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] deleting rbd volume volume-d9211dad-c088-4c51-bb35-06360eca52be {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:15:00.662246 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Created reservations ['a3a6e75f-4290-4939-a54a-4dabcdca0f28', '5cbb52b3-83ac-48e0-9482-91e6b9a45dec', '3323df5f-8a0f-4f2e-bba7-1d61f2bd0f19', '4e94e40e-e4c9-468c-8caf-c63e1bff8253'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:15:00.856496 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:00.992672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:01.168500 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:15:01.184532 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Deleted volume successfully.
Aug 06 21:15:01.214294 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-200deccb-5099-46c8-b61c-9763b1c0a273 tempest-VolumesSnapshotListTestJSON-2020555594 None] Lock "cinder-d9211dad-c088-4c51-bb35-06360eca52be-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:15:05.079121 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:15:05.127028 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Flow 'volume_create_manager' (5771e62d-3bfb-47ad-9c19-c994121b3da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:05.141927 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1592b835-0475-4d30-934a-35e7e0a81951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.190926 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1592b835-0475-4d30-934a-35e7e0a81951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-1648238851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=073f24ad-642f-4fb1-a27b-75805e484b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eac66fd39bd0418cbcb0c455490c8252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:15:05Z,use_quota=True,user_id='b5c980227a7e4cdc8059b40f8c4f2ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c55a19fd-f081-45f2-8fd9-dad29a96c14c),volume_type_id=c55a19fd-f081-45f2-8fd9-dad29a96c14c)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.221431 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e51fcd-5df3-4614-a062-b84cf60b2f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.236157 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e51fcd-5df3-4614-a062-b84cf60b2f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.252860 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0060f6-c21e-44a3-9211-3eda8120b7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.264948 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a0060f6-c21e-44a3-9211-3eda8120b7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '073f24ad-642f-4fb1-a27b-75805e484b20', 'volume_name': 'volume-073f24ad-642f-4fb1-a27b-75805e484b20', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.298603 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d72a3f-c16f-4af7-b5e1-f4e27e650cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.308425 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d72a3f-c16f-4af7-b5e1-f4e27e650cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.336054 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcafd53d-1de8-435d-82a5-8e92a1003b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.340100 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Volume 073f24ad-642f-4fb1-a27b-75805e484b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-073f24ad-642f-4fb1-a27b-75805e484b20', 'volume_size': 1}
Aug 06 21:15:05.342020 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] creating volume 'volume-073f24ad-642f-4fb1-a27b-75805e484b20' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:15:05.345230 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:05.517620 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:15:05.518903 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:15:05.522490 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcafd53d-1de8-435d-82a5-8e92a1003b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073f24ad-642f-4fb1-a27b-75805e484b20', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.526941 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d113e39-5d3a-47a7-b911-1a6730b88ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:05.572048 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Volume volume-073f24ad-642f-4fb1-a27b-75805e484b20 (073f24ad-642f-4fb1-a27b-75805e484b20): created successfully
Aug 06 21:15:05.579016 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d113e39-5d3a-47a7-b911-1a6730b88ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:05.594272 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Flow 'volume_create_manager' (5771e62d-3bfb-47ad-9c19-c994121b3da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:05.633204 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3cf0295b-b0c2-411f-838a-3d751644b577 tempest-VolumeTypesTest-631330266 None] Created volume successfully.
Aug 06 21:15:06.724103 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-facac508-1b27-44d0-b117-8a4997d447b6 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:06.834746 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-facac508-1b27-44d0-b117-8a4997d447b6 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:06.928928 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-facac508-1b27-44d0-b117-8a4997d447b6 tempest-VolumeTypesTest-631330266 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:15:06.943924 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-facac508-1b27-44d0-b117-8a4997d447b6 tempest-VolumeTypesTest-631330266 None] Retype volume completed successfully.
Aug 06 21:15:09.640284 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Acquiring lock "cinder-073f24ad-642f-4fb1-a27b-75805e484b20-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:15:09.652584 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Lock "cinder-073f24ad-642f-4fb1-a27b-75805e484b20-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:15:09.762209 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:09.900656 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:15:09.900975 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Volume volume-073f24ad-642f-4fb1-a27b-75805e484b20 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:15:09.911614 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] deleting rbd volume volume-073f24ad-642f-4fb1-a27b-75805e484b20 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:15:10.381263 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1438544213 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1438544213, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:15:10.382044 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1438544213 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1438544213, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:15:10.411938 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Created reservations ['7f475657-78f1-4540-adf6-b45a01c145e8', '391c3f43-9060-4202-bdab-5802ae563542', 'a41895f0-6a81-46ef-9c74-932e7b66b382', '0bfc493d-edce-45e9-85b5-aeb6d791f91e'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:15:10.463955 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=66,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:15:10.472618 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:10.571252 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:10.651510 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:15:10.668027 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Deleted volume successfully.
Aug 06 21:15:10.672207 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:INSERT=12,cinder:SELECT=49,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:15:10.702224 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5ba09781-aab5-4481-9914-a08a8194ec05 tempest-VolumeTypesTest-631330266 None] Lock "cinder-073f24ad-642f-4fb1-a27b-75805e484b20-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:15:20.715738 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:15:20.717269 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:20.826838 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:20.950386 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:15:22.231464 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:DELETE=1,cinder:SELECT=1,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:15:31.692844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:15:31.755488 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Flow 'volume_create_manager' (9609a70a-4657-4984-b692-7f019f1770fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:31.765259 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275660fa-e58b-4fad-8b89-7156896d9cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:31.793403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275660fa-e58b-4fad-8b89-7156896d9cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666454725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4970485e-db5b-4ecd-88c8-20097d3dbdec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15407d6e47c34f588e162af6a190fd99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:15:32Z,use_quota=True,user_id='c9a290f680dc4b5bbec2010d82ed7e27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:31.803756 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69598-0693-473b-8796-58147229a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:31.812537 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bd69598-0693-473b-8796-58147229a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:31.824846 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d2129-9ed2-473a-a4bd-1c634724500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:31.829624 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3d2129-9ed2-473a-a4bd-1c634724500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4970485e-db5b-4ecd-88c8-20097d3dbdec', 'volume_name': 'volume-4970485e-db5b-4ecd-88c8-20097d3dbdec', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:31.849094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b86923-db5f-45e4-8ab0-2eec92e17160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:31.859918 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84b86923-db5f-45e4-8ab0-2eec92e17160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:31.874338 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91594795-7ff4-4265-aefb-c4032864a81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:31.877716 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Volume 4970485e-db5b-4ecd-88c8-20097d3dbdec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4970485e-db5b-4ecd-88c8-20097d3dbdec', 'volume_size': 1}
Aug 06 21:15:31.878325 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] creating volume 'volume-4970485e-db5b-4ecd-88c8-20097d3dbdec' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:15:31.879305 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:32.096417 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:15:32.096417 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:15:32.100747 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91594795-7ff4-4265-aefb-c4032864a81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4970485e-db5b-4ecd-88c8-20097d3dbdec', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:32.108521 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd37ade-e3ea-4e5f-afcc-00ee33b36be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:32.133773 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Volume volume-4970485e-db5b-4ecd-88c8-20097d3dbdec (4970485e-db5b-4ecd-88c8-20097d3dbdec): created successfully
Aug 06 21:15:32.142974 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd37ade-e3ea-4e5f-afcc-00ee33b36be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:32.154375 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Flow 'volume_create_manager' (9609a70a-4657-4984-b692-7f019f1770fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:32.185600 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-02a6efcc-3fa9-447a-9a91-a601f167342f tempest-VolumesActionsTest-686134703 None] Created volume successfully.
Aug 06 21:15:42.238948 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:15:52.525695 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-33dba7ff-ed29-4bcc-a222-d4cda54b7831 tempest-VolumesActionsTest-686134703 None] Acquiring lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" by "attach_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:15:52.539596 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-33dba7ff-ed29-4bcc-a222-d4cda54b7831 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" acquired by "attach_volume" :: waited 0.014s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:15:52.621320 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:15:52.679133 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-33dba7ff-ed29-4bcc-a222-d4cda54b7831 tempest-VolumesActionsTest-686134703 None] Attaching volume 4970485e-db5b-4ecd-88c8-20097d3dbdec to instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6 at mountpoint /dev/sdb on host None.
Aug 06 21:15:52.747527 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-33dba7ff-ed29-4bcc-a222-d4cda54b7831 tempest-VolumesActionsTest-686134703 None] Attach volume completed successfully.
Aug 06 21:15:52.756474 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-33dba7ff-ed29-4bcc-a222-d4cda54b7831 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" released by "attach_volume" :: held 0.217s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:15:52.983654 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b06ed473-dcc2-49b4-b572-acc4fac5e98f tempest-VolumesActionsTest-686134703 None] Acquiring lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" by "detach_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:15:52.994620 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b06ed473-dcc2-49b4-b572-acc4fac5e98f tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:15:52.995364 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b06ed473-dcc2-49b4-b572-acc4fac5e98f tempest-VolumesActionsTest-686134703 None] Detaching volume 4970485e-db5b-4ecd-88c8-20097d3dbdec from instance 459d01c8-10f7-49cd-9bb5-eadc062b33e6.
Aug 06 21:15:53.084893 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b06ed473-dcc2-49b4-b572-acc4fac5e98f tempest-VolumesActionsTest-686134703 None] Detach volume completed successfully.
Aug 06 21:15:53.097583 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b06ed473-dcc2-49b4-b572-acc4fac5e98f tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:15:54.750464 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:15:54.790747 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (d9c69c52-ab93-4a01-b09c-47a8000b23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:54.811509 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4988f6bf-9796-4775-bcfa-f2bda4c287b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:54.848466 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4988f6bf-9796-4775-bcfa-f2bda4c287b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1025642142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5bfb584-14c9-43da-b272-f3971601f570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4980bb21b59412ca004d8069525d3b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:15:55Z,use_quota=True,user_id='1d7b9e27983940dcaf0e92f62273c588',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:54.863117 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426b88b7-1054-4584-b496-189cef84f8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:54.875364 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426b88b7-1054-4584-b496-189cef84f8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:54.885385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6208a864-8514-4251-85d1-c0f9a44d8381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:54.895839 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6208a864-8514-4251-85d1-c0f9a44d8381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5bfb584-14c9-43da-b272-f3971601f570', 'volume_name': 'volume-b5bfb584-14c9-43da-b272-f3971601f570', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:54.934505 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c089af7b-e00b-4b36-9587-cfee30dcf0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:54.949628 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c089af7b-e00b-4b36-9587-cfee30dcf0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:54.963039 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52af362f-329a-4aaa-91a8-fe1189df424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:54.989549 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Volume b5bfb584-14c9-43da-b272-f3971601f570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5bfb584-14c9-43da-b272-f3971601f570', 'volume_size': 1}
Aug 06 21:15:54.990012 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] creating volume 'volume-b5bfb584-14c9-43da-b272-f3971601f570' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:15:54.990799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:15:55.164567 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:15:55.164986 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:15:55.170381 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52af362f-329a-4aaa-91a8-fe1189df424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5bfb584-14c9-43da-b272-f3971601f570', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:55.178854 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76fc0c2-33ca-4738-9ae3-6b1bbac767d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:15:55.206070 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-b5bfb584-14c9-43da-b272-f3971601f570 (b5bfb584-14c9-43da-b272-f3971601f570): created successfully
Aug 06 21:15:55.215136 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76fc0c2-33ca-4738-9ae3-6b1bbac767d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:15:55.226097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Flow 'volume_create_manager' (d9c69c52-ab93-4a01-b09c-47a8000b23a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:15:55.243512 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b09aa86e-a2a8-48e6-a867-5a3ca4c45542 tempest-AttachVolumeNegativeTest-1196263590 None] Created volume successfully.
Aug 06 21:15:56.789409 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-8f0868e9-efe4-443a-9f7a-d54aa132983f req-a93530a7-e412-4616-8182-49d7e45415a1 tempest-AttachVolumeNegativeTest-1196263590 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:15:58.030523 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-8f0868e9-efe4-443a-9f7a-d54aa132983f req-a93530a7-e412-4616-8182-49d7e45415a1 tempest-AttachVolumeNegativeTest-1196263590 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.243s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:15:58.032824 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-8f0868e9-efe4-443a-9f7a-d54aa132983f req-a93530a7-e412-4616-8182-49d7e45415a1 tempest-AttachVolumeNegativeTest-1196263590 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b5bfb584-14c9-43da-b272-f3971601f570', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'b5bfb584-14c9-43da-b272-f3971601f570', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:15:58.070139 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-8f0868e9-efe4-443a-9f7a-d54aa132983f req-a93530a7-e412-4616-8182-49d7e45415a1 tempest-AttachVolumeNegativeTest-1196263590 None] Connection info returned from driver {'name': 'volumes/volume-b5bfb584-14c9-43da-b272-f3971601f570', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'b5bfb584-14c9-43da-b272-f3971601f570', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '38829b1c-bd30-46a9-b13c-cfd07e6fe0df'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:15:58.162638 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-8f0868e9-efe4-443a-9f7a-d54aa132983f req-a93530a7-e412-4616-8182-49d7e45415a1 tempest-AttachVolumeNegativeTest-1196263590 None] attachment_update completed successfully.
Aug 06 21:16:02.499115 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-760133e1-87af-44db-b0bb-8f545ac01142 req-0501f749-be7e-4695-ade6-ce1fccacf0f8 tempest-AttachVolumeNegativeTest-1196263590 None] Terminate volume connection completed successfully.
Aug 06 21:16:02.501005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-760133e1-87af-44db-b0bb-8f545ac01142 req-0501f749-be7e-4695-ade6-ce1fccacf0f8 tempest-AttachVolumeNegativeTest-1196263590 None] Deleting attachment 38829b1c-bd30-46a9-b13c-cfd07e6fe0df. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:16:12.039836 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Acquiring lock "cinder-b5bfb584-14c9-43da-b272-f3971601f570-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:12.055265 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-b5bfb584-14c9-43da-b272-f3971601f570-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:12.116808 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:12.224369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:16:12.224872 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-b5bfb584-14c9-43da-b272-f3971601f570 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:16:12.244172 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] deleting rbd volume volume-b5bfb584-14c9-43da-b272-f3971601f570 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:16:12.533476 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=35,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:16:12.590762 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Created reservations ['cc525201-86c3-417b-a3f4-3ec1f64ca64f', 'bf6cada0-068a-4544-8026-736b6468a92b', '45e4e685-6cff-41ed-bbb2-c1a1e34cb2dc', 'fed882ae-3063-4e5a-bf04-3af270dbbc87'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:16:12.689648 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:12.794034 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:12.880097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:16:12.885988 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Deleted volume successfully.
Aug 06 21:16:12.914165 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-184302f5-7525-4886-8bb0-5e0f629074fb tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-b5bfb584-14c9-43da-b272-f3971601f570-delete_volume" released by "delete_volume" :: held 0.859s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:13.749677 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Acquiring lock "cinder-ce9057e2-c953-4b6c-ab01-a1beb7796115-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:13.771702 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-ce9057e2-c953-4b6c-ab01-a1beb7796115-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:13.840846 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:13.939689 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:16:13.940375 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-ce9057e2-c953-4b6c-ab01-a1beb7796115 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:16:13.953429 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] deleting rbd volume volume-ce9057e2-c953-4b6c-ab01-a1beb7796115 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:16:14.381350 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Created reservations ['54fd740e-de25-4813-a0db-1be7f48b0bce', 'f5e12355-432d-42d6-a6b7-39c0bc875cef', '8970109c-e40e-423e-b12f-fd3182e0cb28', 'fdf501ac-051a-44a9-b3c8-4a649cd54ac6'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:16:14.505786 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:14.591402 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:14.652605 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:16:14.657492 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Deleted volume successfully.
Aug 06 21:16:14.683679 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-d7870e6a-2b43-47a1-b428-d98c37b2811a tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-ce9057e2-c953-4b6c-ab01-a1beb7796115-delete_volume" released by "delete_volume" :: held 0.913s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:15.736342 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Acquiring lock "cinder-da21e4cb-8f2e-4146-9204-b6a84bccd68b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:15.748746 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-da21e4cb-8f2e-4146-9204-b6a84bccd68b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:15.813848 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:15.881902 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:16:15.882324 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Volume volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:16:15.903333 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] deleting rbd volume volume-da21e4cb-8f2e-4146-9204-b6a84bccd68b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:16:16.211221 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Created reservations ['685b6781-5b00-40ab-a27b-54d2c737e418', '47161c0c-4d69-47a4-a105-c5f3d39850f2', 'ccffc777-58e4-4ca2-8591-93be0ad6e31d', '02c5c86d-c4c0-4a77-a693-b681316ff229'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:16:16.286358 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:16.351940 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:16.401664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:16:16.413938 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Deleted volume successfully.
Aug 06 21:16:16.434401 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-09a110d8-fe31-40a0-baaf-3c7bc138756f tempest-AttachVolumeNegativeTest-1196263590 None] Lock "cinder-da21e4cb-8f2e-4146-9204-b6a84bccd68b-delete_volume" released by "delete_volume" :: held 0.689s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:18.216336 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-526fc2d1-3da0-4428-b6dc-781ce059da1b tempest-VolumesActionsTest-686134703 None] Acquiring lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" by "attach_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:18.228919 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-526fc2d1-3da0-4428-b6dc-781ce059da1b tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" acquired by "attach_volume" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:18.278419 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=68,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:16:18.283739 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-526fc2d1-3da0-4428-b6dc-781ce059da1b tempest-VolumesActionsTest-686134703 None] Attaching volume 4970485e-db5b-4ecd-88c8-20097d3dbdec to instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a at mountpoint /dev/sdb on host None.
Aug 06 21:16:18.320614 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-526fc2d1-3da0-4428-b6dc-781ce059da1b tempest-VolumesActionsTest-686134703 None] Attach volume completed successfully.
Aug 06 21:16:18.330283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-526fc2d1-3da0-4428-b6dc-781ce059da1b tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec" released by "attach_volume" :: held 0.101s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:18.565040 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b35f2f62-d82d-4fc4-8d54-ce70bfb8e082 tempest-VolumesActionsTest-686134703 None] Acquiring lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" by "detach_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:18.578327 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b35f2f62-d82d-4fc4-8d54-ce70bfb8e082 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:18.578877 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b35f2f62-d82d-4fc4-8d54-ce70bfb8e082 tempest-VolumesActionsTest-686134703 None] Detaching volume 4970485e-db5b-4ecd-88c8-20097d3dbdec from instance 3e0dd54b-c337-46f7-93dd-8b031d29e40a.
Aug 06 21:16:18.676259 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b35f2f62-d82d-4fc4-8d54-ce70bfb8e082 tempest-VolumesActionsTest-686134703 None] Detach volume completed successfully.
Aug 06 21:16:18.682238 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b35f2f62-d82d-4fc4-8d54-ce70bfb8e082 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:24.147319 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Acquiring lock "cinder-789975ac-83d5-4333-9996-bffa549e21f9-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:24.160769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Lock "cinder-789975ac-83d5-4333-9996-bffa549e21f9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:24.219937 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=51,cinder:INSERT=9,cinder:UPDATE=38,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:16:24.244589 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:24.327884 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:16:24.328311 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Volume volume-789975ac-83d5-4333-9996-bffa549e21f9 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:16:24.340781 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] deleting rbd volume volume-789975ac-83d5-4333-9996-bffa549e21f9 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:16:24.790079 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Created reservations ['69e4e9f7-a946-4efd-bbba-e8494973c9e9', '20d9a01f-658f-47da-91dc-839962a62fdb', 'cf7fce78-786f-44bc-80d6-48277275cdbb', '00d2c6a8-884d-4cf8-9075-65c45519d771'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:16:24.877672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:24.931108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:24.992584 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:16:24.997241 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Deleted volume successfully.
Aug 06 21:16:25.020000 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ba0ebc37-ac9f-4de5-99d8-4b61b0935d80 tempest-ServersNegativeTestJSON-391655129 None] Lock "cinder-789975ac-83d5-4333-9996-bffa549e21f9-delete_volume" released by "delete_volume" :: held 0.859s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:25.408476 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Acquiring lock "cinder-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:16:25.433103 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Lock "cinder-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:16:25.504756 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-215b0afd-66cd-43c6-950f-b5354fa9d603 tempest-VolumesActionsTest-686134703 None] Running cmd (subprocess): rbd export --pool volumes volume-4970485e-db5b-4ecd-88c8-20097d3dbdec /opt/stack/data/cinder/conversion/volume-4970485e-db5b-4ecd-88c8-20097d3dbdec-a0e2f1c7-7e09-4ca9-8aff-7409dd89ce41 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:16:25.543619 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:25.619122 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:16:25.620034 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Volume volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:16:25.644340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] deleting rbd volume volume-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:16:26.025488 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Created reservations ['2b9dbb05-7b64-4e62-9e20-db38dab84154', 'd84606d6-8c22-4ccf-8ac5-8e7990ed3c9c', '20147728-2a8d-4e9b-b44a-df03610605f0', '57bf40b5-3833-42a4-ab14-9f975366b493'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:16:26.140390 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:26.237699 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:16:26.323535 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:16:26.328891 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Deleted volume successfully.
Aug 06 21:16:26.350945 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0abd9ca7-1b90-4b9c-9cbd-cf44912dc92d tempest-ServersNegativeTestJSON-391655129 None] Lock "cinder-a21fcb0b-4e37-41f5-b4e0-0e0479e5c1a7-delete_volume" released by "delete_volume" :: held 0.916s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:16:27.099339 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-215b0afd-66cd-43c6-950f-b5354fa9d603 tempest-VolumesActionsTest-686134703 None] CMD "rbd export --pool volumes volume-4970485e-db5b-4ecd-88c8-20097d3dbdec /opt/stack/data/cinder/conversion/volume-4970485e-db5b-4ecd-88c8-20097d3dbdec-a0e2f1c7-7e09-4ca9-8aff-7409dd89ce41 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.595s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:16:27.116019 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.image_utils [None req-215b0afd-66cd-43c6-950f-b5354fa9d603 tempest-VolumesActionsTest-686134703 None] a0e2f1c7-7e09-4ca9-8aff-7409dd89ce41 was raw, no need to convert to raw {{(pid=135688) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:851}}
Aug 06 21:16:52.248839 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=41,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:17:02.276538 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=17 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:17:14.930097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-215b0afd-66cd-43c6-950f-b5354fa9d603 tempest-VolumesActionsTest-686134703 None] Uploaded volume to glance image-id: a0e2f1c7-7e09-4ca9-8aff-7409dd89ce41. {{(pid=135688) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1791}}
Aug 06 21:17:14.976738 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-215b0afd-66cd-43c6-950f-b5354fa9d603 tempest-VolumesActionsTest-686134703 None] Copy volume to image completed successfully.
Aug 06 21:17:17.391109 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Acquiring lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:17:17.406517 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:17:17.543242 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:17:17.665411 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:17:17.665939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Volume volume-4970485e-db5b-4ecd-88c8-20097d3dbdec is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:17:17.680769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] deleting rbd volume volume-4970485e-db5b-4ecd-88c8-20097d3dbdec {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:17:18.116485 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Created reservations ['6289f2d7-2011-4417-b081-eaa24af4f8bf', '94f0843b-f017-4ccf-ad20-f248d851105d', 'cc6567c1-d8e5-4168-af7c-ae4dc0fc8008', '9fad38c0-664c-4ea1-8150-eaa645223a21'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:17:18.205056 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:17:18.297874 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:17:18.378821 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:17:18.383239 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Deleted volume successfully.
Aug 06 21:17:18.407115 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-840a5936-31b4-42a9-9f77-0e0d4c2c5640 tempest-VolumesActionsTest-686134703 None] Lock "cinder-4970485e-db5b-4ecd-88c8-20097d3dbdec-delete_volume" released by "delete_volume" :: held 1.001s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:17:20.721850 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:17:20.724979 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:17:20.815511 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:17:20.895463 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:17:32.253576 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:17:42.253408 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=21,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:17:52.262056 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:18:02.288733 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:18:12.267209 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:18:20.714706 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:18:20.715406 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:18:20.796782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:18:20.849671 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:18:21.108776 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:18:21.166318 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Flow 'volume_create_manager' (b766e519-3cea-404c-86cd-5d4a1f26d507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:18:21.177160 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139f818-0673-4595-9d5c-92ec63056d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.217397 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a139f818-0673-4595-9d5c-92ec63056d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1026288679',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=2ff735e5-1c13-4f4b-a375-3a73824d0945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb3b91ed1294ea187812b7312601b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:18:21Z,use_quota=True,user_id='65e64ff8f2b14f70b1b05327f691701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.226811 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73d7229-e5e2-41d9-ac4d-9c4dcbaeaa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.230925 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b73d7229-e5e2-41d9-ac4d-9c4dcbaeaa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.261213 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0524ff38-9193-4903-b1e9-9883eea9cbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.273469 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0524ff38-9193-4903-b1e9-9883eea9cbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ff735e5-1c13-4f4b-a375-3a73824d0945', 'volume_name': 'volume-2ff735e5-1c13-4f4b-a375-3a73824d0945', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.286287 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c20ffc7-03b0-4f4e-ace5-bcbd9b38c4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.293566 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c20ffc7-03b0-4f4e-ace5-bcbd9b38c4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.307925 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51628d31-dd25-42a7-9c3e-6d63b391e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.313515 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume 2ff735e5-1c13-4f4b-a375-3a73824d0945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ff735e5-1c13-4f4b-a375-3a73824d0945', 'volume_size': 1}
Aug 06 21:18:21.314159 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] creating volume 'volume-2ff735e5-1c13-4f4b-a375-3a73824d0945' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:18:21.316573 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:18:21.468416 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:18:21.468796 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:18:21.472610 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51628d31-dd25-42a7-9c3e-6d63b391e952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ff735e5-1c13-4f4b-a375-3a73824d0945', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.480826 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5c810-b448-40ed-9bc3-5dca11832278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:18:21.497741 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume volume-2ff735e5-1c13-4f4b-a375-3a73824d0945 (2ff735e5-1c13-4f4b-a375-3a73824d0945): created successfully
Aug 06 21:18:21.502200 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc5c810-b448-40ed-9bc3-5dca11832278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:18:21.511184 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Flow 'volume_create_manager' (b766e519-3cea-404c-86cd-5d4a1f26d507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:18:21.550810 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4a2b3352-3204-48e3-b151-22ce3284ff06 tempest-AttachVolumeShelveTestJSON-1443103339 None] Created volume successfully.
Aug 06 21:18:42.253958 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:18:52.254335 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:19:02.276986 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:19:16.255580 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 req-61c14a2b-67d0-425d-9c91-fc0df2bd2be9 tempest-AttachVolumeShelveTestJSON-1443103339 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:19:17.716530 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 req-61c14a2b-67d0-425d-9c91-fc0df2bd2be9 tempest-AttachVolumeShelveTestJSON-1443103339 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.461s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:19:17.718631 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 req-61c14a2b-67d0-425d-9c91-fc0df2bd2be9 tempest-AttachVolumeShelveTestJSON-1443103339 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-2ff735e5-1c13-4f4b-a375-3a73824d0945', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '2ff735e5-1c13-4f4b-a375-3a73824d0945', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:19:17.755680 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 req-61c14a2b-67d0-425d-9c91-fc0df2bd2be9 tempest-AttachVolumeShelveTestJSON-1443103339 None] Connection info returned from driver {'name': 'volumes/volume-2ff735e5-1c13-4f4b-a375-3a73824d0945', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '2ff735e5-1c13-4f4b-a375-3a73824d0945', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd3c629d1-3220-42b3-a560-ed399ae613d7'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:19:17.819379 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-d2737fd1-f16c-4c2b-9ea7-75f8f4fd2c65 req-61c14a2b-67d0-425d-9c91-fc0df2bd2be9 tempest-AttachVolumeShelveTestJSON-1443103339 None] attachment_update completed successfully.
Aug 06 21:19:20.716371 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:19:20.717301 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:20.792595 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:20.827660 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:19:21.769746 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-dab11555-4ac0-4322-a6b0-eac336c31d1f tempest-GroupSnapshotsV319Test-486880322 None] Group tempest-GroupSnapshotsV319Test-Group-1271329499: creating
Aug 06 21:19:21.817782 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-dab11555-4ac0-4322-a6b0-eac336c31d1f tempest-GroupSnapshotsV319Test-486880322 None] Group tempest-GroupSnapshotsV319Test-Group-1271329499: created successfully
Aug 06 21:19:21.836821 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-dab11555-4ac0-4322-a6b0-eac336c31d1f tempest-GroupSnapshotsV319Test-486880322 None] Create group completed successfully.
Aug 06 21:19:23.689371 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=24,cinder:UPDATE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:19:23.697131 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:19:23.723032 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Flow 'volume_create_manager' (a435dbde-d2af-4718-8fb1-2305529d3267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:19:23.732490 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149962c4-b1a9-4d87-b08f-772d1c08685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:23.817799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149962c4-b1a9-4d87-b08f-772d1c08685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsV319Test-Volume-853631058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=75772fe5-0e8f-4c3c-b5e9-49594af61e63,host='ncdv-master-1@ceph#ceph',id=6fd81490-ca8d-4395-a811-61095011b864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0931d8d3e6b8472d9bc52f8e51612b7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:19:24Z,use_quota=True,user_id='c70635d7cb6a4e28b8ba7a1c0efc5521',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a299f61-3093-41a1-aa9f-956a4ee6ed84),volume_type_id=4a299f61-3093-41a1-aa9f-956a4ee6ed84)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:23.818291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a40df4-ed1d-4aab-bb77-a41366bf6bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:23.818291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a40df4-ed1d-4aab-bb77-a41366bf6bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:23.823680 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc44fd-e721-456e-b5af-5a54a49a1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:23.839810 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bffc44fd-e721-456e-b5af-5a54a49a1301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fd81490-ca8d-4395-a811-61095011b864', 'volume_name': 'volume-6fd81490-ca8d-4395-a811-61095011b864', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:23.850739 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a537407b-2fe1-4f9e-b52f-78488536230d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:23.855143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a537407b-2fe1-4f9e-b52f-78488536230d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:23.870145 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43233198-cbd4-4f20-b80a-5620bc107e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:23.872416 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Volume 6fd81490-ca8d-4395-a811-61095011b864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fd81490-ca8d-4395-a811-61095011b864', 'volume_size': 1}
Aug 06 21:19:23.872416 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] creating volume 'volume-6fd81490-ca8d-4395-a811-61095011b864' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:19:23.876513 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:23.995798 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:19:23.996188 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:19:24.000831 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43233198-cbd4-4f20-b80a-5620bc107e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd81490-ca8d-4395-a811-61095011b864', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:24.006140 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e488630-95b4-4c3a-bf4a-b9567953536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:24.029071 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Volume volume-6fd81490-ca8d-4395-a811-61095011b864 (6fd81490-ca8d-4395-a811-61095011b864): created successfully
Aug 06 21:19:24.033350 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e488630-95b4-4c3a-bf4a-b9567953536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:24.043803 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Flow 'volume_create_manager' (a435dbde-d2af-4718-8fb1-2305529d3267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:19:24.064326 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5bbe08d2-9722-4591-863e-004289abc334 tempest-GroupSnapshotsV319Test-486880322 None] Created volume successfully.
Aug 06 21:19:25.376874 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e7b25dea-9da8-4e4d-a33d-b00f6f9cb3ae tempest-GroupSnapshotsV319Test-486880322 None] GroupSnapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: creating.
Aug 06 21:19:25.536626 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-e7b25dea-9da8-4e4d-a33d-b00f6f9cb3ae tempest-GroupSnapshotsV319Test-486880322 None] Group snapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: creating. {{(pid=135688) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4121}}
Aug 06 21:19:25.584349 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e7b25dea-9da8-4e4d-a33d-b00f6f9cb3ae tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:26.882250 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e7b25dea-9da8-4e4d-a33d-b00f6f9cb3ae tempest-GroupSnapshotsV319Test-486880322 None] group_snapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: created successfully
Aug 06 21:19:28.258038 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] group_snapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: deleting
Aug 06 21:19:28.345035 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] group_snapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: deleting {{(pid=135688) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4296}}
Aug 06 21:19:28.372069 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:29.703646 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1822607361 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1822607361, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:19:29.704611 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1822607361 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1822607361, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:19:29.745944 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] Created reservations ['e8086d5a-7ea7-403b-9787-4e4ecc55c203', '228bb418-41a5-4ef9-acf2-d55baf32d768', 'a6394417-aa84-4393-a5f3-cdad4a138538', '78fc490e-aa43-46b3-8c4e-166f37564d64'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:19:29.832721 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3ed9bf18-dff2-437b-9ab5-a8f32eb8effe tempest-GroupSnapshotsV319Test-486880322 None] group_snapshot 68d66ee9-9fc8-419c-b5c2-24cc6eeabc23: deleted successfully
Aug 06 21:19:31.195966 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:31.275801 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:19:31.276246 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Volume volume-6fd81490-ca8d-4395-a811-61095011b864 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:19:31.282842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] deleting rbd volume volume-6fd81490-ca8d-4395-a811-61095011b864 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:19:31.652185 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Created reservations ['5cab67fb-98f9-4799-9f38-231dd7fdb9d4'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:19:31.739661 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1822607361 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1822607361, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:19:31.766066 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Created reservations ['3539b8c8-ee21-4ada-a17b-e5477fa99bdf', '5c9c9751-a359-4a59-98d4-5edd1fc6f187', '9f152f19-99fc-4614-bf07-d066026a0ae4', '05383fa1-4172-4575-ad12-cfc53df671b8'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:19:31.914137 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=65,cinder:UPDATE=30,cinder:DELETE=1,cinder:INSERT=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:19:31.957911 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:32.080473 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:32.122967 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:19:32.132936 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3ff7d0ff-4a1a-47fe-b067-166d65a8a26a tempest-GroupSnapshotsV319Test-486880322 None] Delete group completed successfully.
Aug 06 21:19:40.588483 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1f3518c4-0d11-492c-831f-545d13325369 tempest-GroupsV320Test-1679947749 None] Group tempest-GroupsV320Test-Group-2047280027: creating
Aug 06 21:19:40.641548 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1f3518c4-0d11-492c-831f-545d13325369 tempest-GroupsV320Test-1679947749 None] Group tempest-GroupsV320Test-Group-2047280027: created successfully
Aug 06 21:19:40.660435 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1f3518c4-0d11-492c-831f-545d13325369 tempest-GroupsV320Test-1679947749 None] Create group completed successfully.
Aug 06 21:19:42.304724 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-f64d70dd-5517-4365-8137-b97f8104fa68 tempest-GroupsV320Test-1679947749 None] Created reservations ['43c257e3-d175-48e0-bb93-b865a5ea8549'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:19:42.353607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f64d70dd-5517-4365-8137-b97f8104fa68 tempest-GroupsV320Test-1679947749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:42.399063 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f64d70dd-5517-4365-8137-b97f8104fa68 tempest-GroupsV320Test-1679947749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:42.470080 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-f64d70dd-5517-4365-8137-b97f8104fa68 tempest-GroupsV320Test-1679947749 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:19:42.476417 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f64d70dd-5517-4365-8137-b97f8104fa68 tempest-GroupsV320Test-1679947749 None] Delete group completed successfully.
Aug 06 21:19:50.428353 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:19:50.453490 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Flow 'volume_create_manager' (3f99f103-0fb7-4f69-a81a-93ccd493eb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:19:50.460633 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a251af87-8d32-4d05-bc8f-1b3c9a436056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.480583 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a251af87-8d32-4d05-bc8f-1b3c9a436056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1291988527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=966074fc-d3e0-4bb3-b3d4-21927c4abd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6b2f97416146d1ae71892d00336d16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:19:50Z,use_quota=True,user_id='9146957461994361b98305f75a4a06d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.488167 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395e5e8a-15d8-4758-bea8-a0ded96ca4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.492743 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395e5e8a-15d8-4758-bea8-a0ded96ca4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.499418 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d16a80-ab1b-4eba-bcd6-67ad3979efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.505519 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31d16a80-ab1b-4eba-bcd6-67ad3979efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966074fc-d3e0-4bb3-b3d4-21927c4abd86', 'volume_name': 'volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.511346 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3e7186-7172-4763-bb52-c9819bf9b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.516216 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3e7186-7172-4763-bb52-c9819bf9b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.532968 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8947b29-3640-4063-9973-fdcdf4c73604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.534768 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Volume 966074fc-d3e0-4bb3-b3d4-21927c4abd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86', 'volume_size': 1}
Aug 06 21:19:50.535935 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] creating volume 'volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:19:50.537246 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:50.628260 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:19:50.628698 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:19:50.634333 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8947b29-3640-4063-9973-fdcdf4c73604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.645079 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd7c932-1d34-477e-8adf-9f275c5e8ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:19:50.679973 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Volume volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86 (966074fc-d3e0-4bb3-b3d4-21927c4abd86): created successfully
Aug 06 21:19:50.685037 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdd7c932-1d34-477e-8adf-9f275c5e8ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:19:50.701326 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Flow 'volume_create_manager' (3f99f103-0fb7-4f69-a81a-93ccd493eb3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:19:50.718238 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-195cbc7f-2b49-4ccf-88fb-adea20005f8d tempest-SnapshotsActionsTest-206584223 None] Created volume successfully.
Aug 06 21:19:51.781557 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df05cd59-6576-44fc-877c-3e95f85b1aa9 tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:52.755933 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=74,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:19:52.773009 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-df05cd59-6576-44fc-877c-3e95f85b1aa9 tempest-SnapshotsActionsTest-206584223 None] Create snapshot completed successfully
Aug 06 21:19:55.302346 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4fc36d67-38dc-459a-993e-b816c1f65276 tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:55.875828 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4fc36d67-38dc-459a-993e-b816c1f65276 tempest-SnapshotsActionsTest-206584223 None] Create snapshot completed successfully
Aug 06 21:19:56.738215 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] Acquiring lock "cinder-37d93057-057f-469b-a999-64385479c922-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:19:56.755235 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-37d93057-057f-469b-a999-64385479c922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:19:56.759348 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:19:57.935076 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] Created reservations ['9361ae0e-30c9-4182-a08c-baa952cf425c', '6a231315-5b13-4f91-b0fc-958a624bc847', 'c0cb22b8-33ff-4888-aed1-9b9c861ab4e4', 'f24e6e8d-0e02-4877-91dd-3f92e3b26e71'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:19:58.042191 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] Delete snapshot completed successfully.
Aug 06 21:19:58.051637 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-4c08aede-d4bc-4919-90ae-8e912cf42a76 tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-37d93057-057f-469b-a999-64385479c922-delete_snapshot" released by "delete_snapshot" :: held 1.297s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:19:59.709882 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9bc60bc8-c0ce-460f-b04a-0147dd7c0b31 tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:00.089918 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9bc60bc8-c0ce-460f-b04a-0147dd7c0b31 tempest-SnapshotsActionsTest-206584223 None] Create snapshot completed successfully
Aug 06 21:20:00.913980 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] Acquiring lock "cinder-eefb467c-6876-409c-b2a2-da414e127942-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:00.953168 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-eefb467c-6876-409c-b2a2-da414e127942-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:00.961599 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:02.146185 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=41,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:20:02.257903 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] Created reservations ['6ddc5145-97bb-4c25-b79e-d4059e0031ba', '218f99d0-97ed-4335-90cb-2f65528c761e', '7af96b6d-8a8b-4e88-a45e-fe024de35c0d', '57c5e0be-37fb-4ae1-8135-ff2823b22178'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:02.367956 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] Delete snapshot completed successfully.
Aug 06 21:20:02.377822 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b3f86396-4f29-4ef3-b5f3-d703a4d19fcd tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-eefb467c-6876-409c-b2a2-da414e127942-delete_snapshot" released by "delete_snapshot" :: held 1.427s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:03.800697 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5af73cf0-8957-4b76-8c09-db04575d1fe0 tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:04.820170 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5af73cf0-8957-4b76-8c09-db04575d1fe0 tempest-SnapshotsActionsTest-206584223 None] Create snapshot completed successfully
Aug 06 21:20:06.121220 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] Acquiring lock "cinder-0aa60ff7-65dc-4224-851d-62660d0b9577-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:06.137070 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-0aa60ff7-65dc-4224-851d-62660d0b9577-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:06.140794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:06.807294 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] Created reservations ['7ca87409-fcef-4220-bae7-a47f02de41d0', '707b1a81-c4cc-49b2-a152-29bafeedc21e', '83177160-8a73-47d2-a33f-908bc3eb4063', 'cf13f7d3-d7c3-4fe3-9b3a-cf3a0668f3a4'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:06.931513 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] Delete snapshot completed successfully.
Aug 06 21:20:06.960781 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-60c14026-de58-491e-b6d5-7af7dc640ed9 tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-0aa60ff7-65dc-4224-851d-62660d0b9577-delete_snapshot" released by "delete_snapshot" :: held 0.826s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:08.047863 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1aa3b296-f5d6-446f-bb80-954c433b9a0c tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:08.740637 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1aa3b296-f5d6-446f-bb80-954c433b9a0c tempest-SnapshotsActionsTest-206584223 None] Create snapshot completed successfully
Aug 06 21:20:09.245215 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] Acquiring lock "cinder-2a4753f6-ba60-47f9-8e4f-b79996ff37af-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:09.262893 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-2a4753f6-ba60-47f9-8e4f-b79996ff37af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:09.264571 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:09.871784 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] Created reservations ['e0bc30e5-c258-4c6d-a3bd-77d5aad4143a', '64f76662-ab9e-4796-9a49-824ad58a07d3', '0f8dcfc2-11b5-4c8c-9daa-bab4665f35bc', '7dfe6fa6-f61c-4127-8248-868c184ddf1b'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:09.952643 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=65,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:20:09.957772 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] Delete snapshot completed successfully.
Aug 06 21:20:09.997491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd47aa3d-c106-4e9f-8d58-cb0bff02447f tempest-SnapshotsActionsTest-1929031149 None] Lock "cinder-2a4753f6-ba60-47f9-8e4f-b79996ff37af-delete_snapshot" released by "delete_snapshot" :: held 0.735s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:11.259927 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] Acquiring lock "cinder-a1dc9139-73b8-42e5-a29a-6f320400ed32-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:11.281404 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] Lock "cinder-a1dc9139-73b8-42e5-a29a-6f320400ed32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:11.286112 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:11.852391 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] Created reservations ['4087eaa2-3ab2-4f1d-b18d-1bef15f7d53a', 'ab589476-ea52-4580-a1c9-f483bc3e6bf5', '77ce6c09-cfa5-4f67-963f-6cb8bad805c6', 'a46a4d96-7c1f-49e3-9045-5ba4a0fc5834'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:11.943798 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] Delete snapshot completed successfully.
Aug 06 21:20:11.948878 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5fa745f9-1b62-425c-9a71-debca484c7e8 tempest-SnapshotsActionsTest-206584223 None] Lock "cinder-a1dc9139-73b8-42e5-a29a-6f320400ed32-delete_snapshot" released by "delete_snapshot" :: held 0.668s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:12.515296 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Acquiring lock "cinder-966074fc-d3e0-4bb3-b3d4-21927c4abd86-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:12.551154 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Lock "cinder-966074fc-d3e0-4bb3-b3d4-21927c4abd86-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:12.659475 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:12.787719 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:20:12.788435 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Volume volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:20:12.805672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] deleting rbd volume volume-966074fc-d3e0-4bb3-b3d4-21927c4abd86 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:20:13.301812 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Created reservations ['ce022eae-c8b4-4c51-98f0-095c80587506', 'dc958e32-5a7b-4875-888c-4d6f7c6afa53', '49f27fa9-6e4e-47e3-8f9f-23bee21b2f28', 'b6b77ad8-01c5-4f4f-a9f9-80eb7d7dded2'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:13.438967 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:13.531656 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:13.713030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:20:13.720653 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Deleted volume successfully.
Aug 06 21:20:13.759148 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-59ef21d8-90d0-4f8c-85cc-9e6217cd9fed tempest-SnapshotsActionsTest-206584223 None] Lock "cinder-966074fc-d3e0-4bb3-b3d4-21927c4abd86-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:20.714714 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:20:20.717228 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:20.825239 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:20.944403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:20:23.384211 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=57,cinder:INSERT=9,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:20:23.400186 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:20:23.452497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (a1fa1af4-d7d8-49b1-bc6e-41d443dcc816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:23.464745 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bd850c-f4cd-436f-936d-21c4de315999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.483430 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bd850c-f4cd-436f-936d-21c4de315999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:20:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-298720266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=57a13f70-62c4-4d1e-b01e-6028424d9ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92773208ca8844d9b32b6c4e2be2b0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:20:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:20:23Z,use_quota=True,user_id='ad9361a4a0c94034b5010bd2ab6d613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.490238 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b01381-202b-41ae-9d39-5894c805bb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.495419 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b01381-202b-41ae-9d39-5894c805bb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.502200 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5537b509-5f18-4630-b838-1a946157de98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.507408 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5537b509-5f18-4630-b838-1a946157de98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'volume_name': 'volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.513711 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161b2f28-8267-4396-968c-2159bdea44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.518538 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (161b2f28-8267-4396-968c-2159bdea44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.524233 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54806320-f4c7-42a1-aca1-98513abd7501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.525742 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Volume 57a13f70-62c4-4d1e-b01e-6028424d9ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'volume_size': 1}
Aug 06 21:20:23.526281 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] creating volume 'volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:20:23.527209 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:23.608668 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:20:23.609390 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:20:23.613107 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54806320-f4c7-42a1-aca1-98513abd7501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.617719 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d4010-5d5c-463d-ae1f-1a64760e62bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:23.628246 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb (57a13f70-62c4-4d1e-b01e-6028424d9ddb): created successfully
Aug 06 21:20:23.631999 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550d4010-5d5c-463d-ae1f-1a64760e62bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:23.637464 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (a1fa1af4-d7d8-49b1-bc6e-41d443dcc816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:23.655585 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-94430143-5cc1-4984-8b0d-2a8582bfe403 tempest-VolumesBackupsAdminTest-140700211 None] Created volume successfully.
Aug 06 21:20:24.946609 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-06T21:20:24Z,data_timestamp=2022-08-06T21:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-980665800',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=dc17fb19-c4b5-4a25-8431-c964ca190eff,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='92773208ca8844d9b32b6c4e2be2b0ce',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ad9361a4a0c94034b5010bd2ab6d613d',volume_id=57a13f70-62c4-4d1e-b01e-6028424d9ddb)
Aug 06 21:20:24.953683 ncdv-master-1 cinder-volume[135688]: INFO cinder.rpc [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Automatically selected cinder-backup objects version 1.39 as minimum service version.
Aug 06 21:20:24.958989 ncdv-master-1 cinder-volume[135688]: INFO cinder.rpc [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Automatically selected cinder-backup RPC version 2.3 as minimum service version.
Aug 06 21:20:24.959783 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.backup.rpcapi [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] continue_backup in rpcapi backup_id dc17fb19-c4b5-4a25-8431-c964ca190eff {{(pid=135688) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 06 21:20:25.469388 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-7504fa41-b575-4b2b-ab13-410604294fe5 req-a48744fd-9930-4ff0-8fe5-957a8720e683 tempest-AttachVolumeShelveTestJSON-1443103339 None] Terminate volume connection completed successfully.
Aug 06 21:20:25.470164 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-7504fa41-b575-4b2b-ab13-410604294fe5 req-a48744fd-9930-4ff0-8fe5-957a8720e683 tempest-AttachVolumeShelveTestJSON-1443103339 None] Deleting attachment d3c629d1-3220-42b3-a560-ed399ae613d7. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:20:33.487400 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:20:34.958157 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.470s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:20:34.959048 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '57a13f70-62c4-4d1e-b01e-6028424d9ddb', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:20:34.986390 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Initialize volume connection completed successfully.
Aug 06 21:20:37.070689 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-19205c34-c457-4faf-9dc1-1f5c2a64dabe tempest-BackendsCapabilitiesAdminTestsJSON-2102528544 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:15ef9320-ebbb-4160-936f-b48823c40af2:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135688) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Aug 06 21:20:37.114733 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f1e3ec0-d769-468a-9ec2-19a68ee1eb7d tempest-BackendsCapabilitiesAdminTestsJSON-2102528544 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:15ef9320-ebbb-4160-936f-b48823c40af2:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=135688) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4776}}
Aug 06 21:20:39.161276 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Terminate volume connection completed successfully.
Aug 06 21:20:39.194599 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c0569b5e-7970-4eb5-971a-587810446e79 tempest-VolumesBackupsAdminTest-140700211 None] Remove volume export completed successfully.
Aug 06 21:20:42.271824 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=42,cinder:INSERT=5,cinder:UPDATE=18 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:20:42.378119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:20:42.404094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (8185f492-3a3e-4403-a082-289a878d4a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:42.411909 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6d3a73-a7c8-4c90-bb13-4ff1f14b085b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.435481 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6d3a73-a7c8-4c90-bb13-4ff1f14b085b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:20:42Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_dc17fb19-c4b5-4a25-8431-c964ca190eff',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=b5ece22f-998b-4ca5-85d9-3b5abf69d116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92773208ca8844d9b32b6c4e2be2b0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:20:42Z,use_quota=True,user_id='ad9361a4a0c94034b5010bd2ab6d613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.446389 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a95443b-7569-456d-8f59-e76a776b1c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.476021 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a95443b-7569-456d-8f59-e76a776b1c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.487651 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5f6edc-0aef-420c-9c09-517a1e436c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.499507 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5f6edc-0aef-420c-9c09-517a1e436c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'volume_name': 'volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.506573 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45c38b2-3823-4f0f-9cf1-d7c6f5359efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.513804 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b45c38b2-3823-4f0f-9cf1-d7c6f5359efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.520097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c001c499-1789-43f1-9933-35e32700b452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.522726 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Volume b5ece22f-998b-4ca5-85d9-3b5abf69d116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'volume_size': 1}
Aug 06 21:20:42.523328 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] creating volume 'volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:20:42.524747 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:42.639304 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:20:42.640259 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:20:42.645634 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c001c499-1789-43f1-9933-35e32700b452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.652551 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902bc529-3998-47fa-af48-bfd9d0a6cd3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:42.665896 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116 (b5ece22f-998b-4ca5-85d9-3b5abf69d116): created successfully
Aug 06 21:20:42.671466 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902bc529-3998-47fa-af48-bfd9d0a6cd3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:42.678735 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (8185f492-3a3e-4403-a082-289a878d4a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:42.694047 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Created volume successfully.
Aug 06 21:20:43.582857 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:20:45.087968 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.512s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:20:45.089226 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'b5ece22f-998b-4ca5-85d9-3b5abf69d116', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:20:45.122053 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Initialize volume connection completed successfully.
Aug 06 21:20:47.054311 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Terminate volume connection completed successfully.
Aug 06 21:20:47.093637 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5280642f-5120-4735-a9cf-1490679ac5de tempest-VolumesBackupsAdminTest-140700211 None] Remove volume export completed successfully.
Aug 06 21:20:47.910575 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Acquiring lock "cinder-b5ece22f-998b-4ca5-85d9-3b5abf69d116-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:47.944865 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-b5ece22f-998b-4ca5-85d9-3b5abf69d116-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:48.025612 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:48.822537 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:20:48.853655 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] deleting rbd volume volume-b5ece22f-998b-4ca5-85d9-3b5abf69d116 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:20:49.205070 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Created reservations ['2f2c23fa-31a0-420c-8996-3114cb899008', 'ba41d479-c146-4a52-8a3b-a7fff48a7c12', '8f28bfaa-17e4-4957-80d7-07c7eceb7ff5', 'd611f06f-9e51-4c31-a71f-fbe67eec8d2f'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:49.292879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:49.354642 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:49.422359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:20:49.427402 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Deleted volume successfully.
Aug 06 21:20:49.452504 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-55e91c38-a78d-4547-a808-54d49ad9b656 tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-b5ece22f-998b-4ca5-85d9-3b5abf69d116-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:51.141013 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:20:51.161743 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Flow 'volume_create_manager' (cfa04037-3131-41c8-8a94-dd6e224990c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:51.168151 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67622556-c8c2-43c9-8465-aa275ed68c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.185017 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67622556-c8c2-43c9-8465-aa275ed68c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-961572609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d6b4db45-8412-47e0-a34e-d6f967691a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cc60bd15a3d41bfab4169351e1bfcb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:20:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:20:51Z,use_quota=True,user_id='6341fe9e44fb4234b7de2c6c5f0ad10a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.190901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2bf491-6a93-4409-85b1-8561d3022a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.194977 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d2bf491-6a93-4409-85b1-8561d3022a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.199981 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8537178-a55e-4ead-9c86-5f2796700b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.204114 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8537178-a55e-4ead-9c86-5f2796700b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6b4db45-8412-47e0-a34e-d6f967691a67', 'volume_name': 'volume-d6b4db45-8412-47e0-a34e-d6f967691a67', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.208885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8988a632-c6d3-43c5-83ce-da5d39546e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.212723 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8988a632-c6d3-43c5-83ce-da5d39546e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.217495 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13014d38-6921-4871-a606-5f01f25fae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.218828 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Volume d6b4db45-8412-47e0-a34e-d6f967691a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6b4db45-8412-47e0-a34e-d6f967691a67', 'volume_size': 1}
Aug 06 21:20:51.219226 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] creating volume 'volume-d6b4db45-8412-47e0-a34e-d6f967691a67' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:20:51.220004 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:51.292315 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:20:51.292690 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:20:51.297654 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13014d38-6921-4871-a606-5f01f25fae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6b4db45-8412-47e0-a34e-d6f967691a67', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.302321 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb65149a-0f8d-43de-aeb1-4aad469c0c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:51.314200 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Volume volume-d6b4db45-8412-47e0-a34e-d6f967691a67 (d6b4db45-8412-47e0-a34e-d6f967691a67): created successfully
Aug 06 21:20:51.319554 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb65149a-0f8d-43de-aeb1-4aad469c0c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:51.328750 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Flow 'volume_create_manager' (cfa04037-3131-41c8-8a94-dd6e224990c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:51.339850 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-34cb0626-2628-4803-8ac2-1d80a92a7a7a tempest-VolumeQuotasNegativeTestJSON-55588550 None] Created volume successfully.
Aug 06 21:20:52.170187 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:20:52.198707 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (f905028a-a28d-431e-9746-f77c18a99b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:52.207741 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815cc65f-ce9b-45ee-9eb8-009de9b0c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.228160 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (815cc65f-ce9b-45ee-9eb8-009de9b0c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1429613579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8c306021-dec4-4ab9-aeb2-2bea07861bfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92773208ca8844d9b32b6c4e2be2b0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:20:52Z,use_quota=True,user_id='ad9361a4a0c94034b5010bd2ab6d613d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.240990 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03ae934-cd39-4cd2-a3b2-ac9a566f6b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.253756 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03ae934-cd39-4cd2-a3b2-ac9a566f6b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.260869 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5c8313-1e13-41c2-b6cb-1d1bf9e3fab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.265955 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5c8313-1e13-41c2-b6cb-1d1bf9e3fab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'volume_name': 'volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.272166 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c7dd7-a6bd-4c9c-920c-36464464a8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.277604 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (783c7dd7-a6bd-4c9c-920c-36464464a8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.283548 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62cf7d8-5a27-43df-9291-f52767714a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.284766 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Volume 8c306021-dec4-4ab9-aeb2-2bea07861bfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'volume_size': 1}
Aug 06 21:20:52.285165 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] creating volume 'volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:20:52.285995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:52.368533 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:20:52.369143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:20:52.379567 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62cf7d8-5a27-43df-9291-f52767714a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.387943 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dfd4f4-11be-43e1-923a-85a4884c37e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:20:52.401332 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa (8c306021-dec4-4ab9-aeb2-2bea07861bfa): created successfully
Aug 06 21:20:52.407568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0dfd4f4-11be-43e1-923a-85a4884c37e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:20:52.416600 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Flow 'volume_create_manager' (f905028a-a28d-431e-9746-f77c18a99b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:20:52.428860 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-18653c3c-3f0c-4666-bc64-e569753e9e8f tempest-VolumesBackupsAdminTest-140700211 None] Created volume successfully.
Aug 06 21:20:53.530579 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-06T21:20:53Z,data_timestamp=2022-08-06T21:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Backup-190401918',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=8bb0e42f-37c0-4f36-920b-b3041a353df4,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='92773208ca8844d9b32b6c4e2be2b0ce',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='ad9361a4a0c94034b5010bd2ab6d613d',volume_id=8c306021-dec4-4ab9-aeb2-2bea07861bfa)
Aug 06 21:20:53.535388 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.backup.rpcapi [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] continue_backup in rpcapi backup_id 8bb0e42f-37c0-4f36-920b-b3041a353df4 {{(pid=135688) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 06 21:20:53.764377 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:20:53.842177 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Acquiring lock "cinder-d6b4db45-8412-47e0-a34e-d6f967691a67-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:20:53.869496 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Lock "cinder-d6b4db45-8412-47e0-a34e-d6f967691a67-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:20:53.893545 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=20,cinder:SELECT=45,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:20:54.077990 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:54.175450 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:20:54.176477 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Volume volume-d6b4db45-8412-47e0-a34e-d6f967691a67 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:20:54.195211 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] deleting rbd volume volume-d6b4db45-8412-47e0-a34e-d6f967691a67 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:20:54.574663 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Created reservations ['33f2db43-3070-45ee-af81-340776d0b8fb', '2e6dc1fd-b8d2-4667-80a7-5438d3303d1a', '1276e4f9-ad7a-451a-a9de-cc55c425ae11', '0da17bed-46e4-4a22-806b-0d5f49867936'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:20:54.649711 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:54.713181 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:20:54.760454 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:20:54.769337 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Deleted volume successfully.
Aug 06 21:20:54.793641 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e20609c6-0d8c-480b-acda-0f87c46e0455 tempest-VolumeQuotasNegativeTestJSON-55588550 None] Lock "cinder-d6b4db45-8412-47e0-a34e-d6f967691a67-delete_volume" released by "delete_volume" :: held 0.924s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:20:55.174525 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.412s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:20:55.175253 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': '8c306021-dec4-4ab9-aeb2-2bea07861bfa', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:20:55.198234 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] Initialize volume connection completed successfully.
Aug 06 21:20:57.037419 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] Terminate volume connection completed successfully.
Aug 06 21:20:57.075256 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0d55a383-3a03-4736-a427-2b9ff79d416c tempest-VolumesBackupsAdminTest-140700211 None] Remove volume export completed successfully.
Aug 06 21:21:00.105948 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Acquiring lock "cinder-8c306021-dec4-4ab9-aeb2-2bea07861bfa-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:00.120436 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-8c306021-dec4-4ab9-aeb2-2bea07861bfa-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:00.200721 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:00.973935 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:01.004989 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] deleting rbd volume volume-8c306021-dec4-4ab9-aeb2-2bea07861bfa {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:01.054132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:01.109261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Flow 'volume_create_manager' (d3602711-a506-4977-b78f-0fa71b5a9893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:01.118162 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69aafd38-3cdf-4cee-89de-46504b1f39e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.141168 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69aafd38-3cdf-4cee-89de-46504b1f39e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1629064034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=bf58c034-2e56-485b-9e6d-57640fbbd523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62156a69d4aa4b5594705bfb60922e67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:00Z,use_quota=True,user_id='244cbb103e3c494aa02b72fe321ca76f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.152622 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872c3a29-b0df-4bbe-bc2d-47b8a67fca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.159023 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872c3a29-b0df-4bbe-bc2d-47b8a67fca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.166453 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed365e-ee14-42e0-8891-6bdf3fa5666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.173399 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ed365e-ee14-42e0-8891-6bdf3fa5666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf58c034-2e56-485b-9e6d-57640fbbd523', 'volume_name': 'volume-bf58c034-2e56-485b-9e6d-57640fbbd523', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.179471 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e6e039-ee8a-4950-af43-0b7240d8fec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.183687 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7e6e039-ee8a-4950-af43-0b7240d8fec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.189143 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d934078b-da74-4ddc-bb58-f66d45da414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.190978 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Volume bf58c034-2e56-485b-9e6d-57640fbbd523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf58c034-2e56-485b-9e6d-57640fbbd523', 'volume_size': 1}
Aug 06 21:21:01.191704 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] creating volume 'volume-bf58c034-2e56-485b-9e6d-57640fbbd523' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:01.193058 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:01.289780 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:01.290672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:01.297878 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d934078b-da74-4ddc-bb58-f66d45da414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf58c034-2e56-485b-9e6d-57640fbbd523', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.304066 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59e5d46-258d-488c-9638-a0f5c861da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:01.336172 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Volume volume-bf58c034-2e56-485b-9e6d-57640fbbd523 (bf58c034-2e56-485b-9e6d-57640fbbd523): created successfully
Aug 06 21:21:01.340002 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59e5d46-258d-488c-9638-a0f5c861da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:01.346262 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Flow 'volume_create_manager' (d3602711-a506-4977-b78f-0fa71b5a9893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:01.362208 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-41cb0611-584b-4d9f-97c5-485e4412eb43 tempest-SnapshotMetadataTestJSON-1305813370 None] Created volume successfully.
Aug 06 21:21:01.390623 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Created reservations ['be0f8265-ca99-4c62-97e9-5a7bba2d1fbe', '4a2c287d-367f-4d44-9240-804bc0649962', '771ddd1f-3af3-4bbb-b896-1650ed7ee818', '6718ebbe-1a59-42ae-a895-3691d7632fff'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:01.436691 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:01.468775 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:01.499095 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:01.503121 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Deleted volume successfully.
Aug 06 21:21:01.517754 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-bd82d570-fd69-4c3e-aea9-d648ea940b6f tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-8c306021-dec4-4ab9-aeb2-2bea07861bfa-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:02.463354 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Acquiring lock "cinder-57a13f70-62c4-4d1e-b01e-6028424d9ddb-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:02.485043 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-57a13f70-62c4-4d1e-b01e-6028424d9ddb-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:02.573401 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:02.996099 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Volume volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:03.026870 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] deleting rbd volume volume-57a13f70-62c4-4d1e-b01e-6028424d9ddb {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:03.075431 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=59,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:03.104955 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-12384747-cb0e-4cbd-a10f-573d99da665c tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:03.363975 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Created reservations ['4a85fde4-c9fc-454c-bcbd-681f4762e6b9', '6da8b0bb-67df-48a8-b069-5380a564134f', '9e3d9a40-c640-4f53-8c62-da5a0024a56a', '26440324-88f1-4be1-947f-a0df87442468'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:03.440664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:03.512564 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:03.579045 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:03.594041 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Deleted volume successfully.
Aug 06 21:21:03.621221 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-255db8c9-46f4-481e-9532-6e09f74dac33 tempest-VolumesBackupsAdminTest-140700211 None] Lock "cinder-57a13f70-62c4-4d1e-b01e-6028424d9ddb-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:03.844324 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-12384747-cb0e-4cbd-a10f-573d99da665c tempest-SnapshotMetadataTestJSON-1305813370 None] Create snapshot completed successfully
Aug 06 21:21:05.721310 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] Acquiring lock "cinder-5e5c1a50-5c4b-425a-be69-678ddd0bf230-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:05.748957 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] Lock "cinder-5e5c1a50-5c4b-425a-be69-678ddd0bf230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:05.751645 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:06.115805 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] Created reservations ['1f48f6cf-3a5c-4428-8040-fed3f08f6ea4', 'bb8ed571-9a00-4354-aedb-826b61b98de9', 'f5359018-8509-4d87-8f97-f72e40cacf03', '4aa8c65f-c639-4198-9e45-1a85e3e54dfa'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:06.143059 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=66,cinder:INSERT=10,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:06.167110 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] Delete snapshot completed successfully.
Aug 06 21:21:06.175627 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2deaa854-9d55-40d1-81cb-2196ae122313 tempest-SnapshotMetadataTestJSON-1305813370 None] Lock "cinder-5e5c1a50-5c4b-425a-be69-678ddd0bf230-delete_snapshot" released by "delete_snapshot" :: held 0.427s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:06.918809 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Acquiring lock "cinder-bf58c034-2e56-485b-9e6d-57640fbbd523-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:06.944769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Lock "cinder-bf58c034-2e56-485b-9e6d-57640fbbd523-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:07.022298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:07.079864 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:07.080199 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Volume volume-bf58c034-2e56-485b-9e6d-57640fbbd523 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:07.086986 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] deleting rbd volume volume-bf58c034-2e56-485b-9e6d-57640fbbd523 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:07.434613 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Created reservations ['436a278c-a31b-4737-9688-8a180ab78688', '8625ad8f-6f81-4906-8c5d-839b7146060c', '5af0340f-e44f-48f1-9a49-711db06e4033', '3701b3b8-75f6-43c8-80fa-a4ab21bf5805'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:07.511517 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:07.562618 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:07.604355 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:07.610712 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Deleted volume successfully.
Aug 06 21:21:07.633944 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f3620eec-7c97-438a-a96b-98c33a9e1c96 tempest-SnapshotMetadataTestJSON-1305813370 None] Lock "cinder-bf58c034-2e56-485b-9e6d-57640fbbd523-delete_volume" released by "delete_volume" :: held 0.689s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:09.379194 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:09.401602 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (0365663c-ee68-464a-afda-70d302f4c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:09.411885 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd043b32-e723-4e16-8157-d07190940f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.435778 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd043b32-e723-4e16-8157-d07190940f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1913572034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3be9895e-456a-4b08-94c6-e045205b3acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d1d87d67b04288b9180302370543a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:09Z,use_quota=True,user_id='28d291870b6444a79541df94ae90cec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.441512 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566e7cfe-bbd8-4408-8a10-839a19e20888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.445782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566e7cfe-bbd8-4408-8a10-839a19e20888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.451902 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20127d8e-c715-42c3-91a8-32be909e003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.456335 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20127d8e-c715-42c3-91a8-32be909e003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be9895e-456a-4b08-94c6-e045205b3acb', 'volume_name': 'volume-3be9895e-456a-4b08-94c6-e045205b3acb', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.461456 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a763bfd9-f99f-444c-908c-d419765c98e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.465814 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a763bfd9-f99f-444c-908c-d419765c98e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.471550 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeed38a-271c-46d1-8b35-3904a69a24d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.473132 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Volume 3be9895e-456a-4b08-94c6-e045205b3acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be9895e-456a-4b08-94c6-e045205b3acb', 'volume_size': 1}
Aug 06 21:21:09.473724 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] creating volume 'volume-3be9895e-456a-4b08-94c6-e045205b3acb' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:09.474788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:09.590397 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:09.591681 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:09.596229 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aeed38a-271c-46d1-8b35-3904a69a24d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be9895e-456a-4b08-94c6-e045205b3acb', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.607376 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f3ab7f-2ed2-402f-ba8a-e0e3ab838125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:09.623567 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-3be9895e-456a-4b08-94c6-e045205b3acb (3be9895e-456a-4b08-94c6-e045205b3acb): created successfully
Aug 06 21:21:09.634437 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35f3ab7f-2ed2-402f-ba8a-e0e3ab838125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:09.663820 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (0365663c-ee68-464a-afda-70d302f4c697) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:09.688479 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7a3c03a3-e6b5-4a28-bde7-f97256a9de13 tempest-VolumesListAdminTestJSON-544701538 None] Created volume successfully.
Aug 06 21:21:10.755758 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c2d4047d-e76e-44f1-b75a-32449967ccb8 tempest-GroupsV314Test-1342897340 None] Group tempest-GroupsV314Test-Group-603891589: creating
Aug 06 21:21:10.781758 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c2d4047d-e76e-44f1-b75a-32449967ccb8 tempest-GroupsV314Test-1342897340 None] Group tempest-GroupsV314Test-Group-603891589: created successfully
Aug 06 21:21:10.796645 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c2d4047d-e76e-44f1-b75a-32449967ccb8 tempest-GroupsV314Test-1342897340 None] Create group completed successfully.
Aug 06 21:21:11.125155 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:11.145138 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (339c0fed-62b1-4d61-84ee-341fa19ab90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:11.153060 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4587d835-5bcb-445f-8be8-ccad690b9b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.172907 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4587d835-5bcb-445f-8be8-ccad690b9b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1141047223',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=11db69bd-4bdb-42c4-9979-ab2bd0eb0bad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d1d87d67b04288b9180302370543a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:11Z,use_quota=True,user_id='28d291870b6444a79541df94ae90cec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.179304 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916f596-0936-473a-afcf-1dddceb6cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.183566 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e916f596-0936-473a-afcf-1dddceb6cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.189962 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710941ad-868b-46d0-9713-a82e16b00cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.194133 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710941ad-868b-46d0-9713-a82e16b00cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11db69bd-4bdb-42c4-9979-ab2bd0eb0bad', 'volume_name': 'volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.199453 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef39664-68f7-42b3-9b53-913c04496d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.204259 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef39664-68f7-42b3-9b53-913c04496d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.210637 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b20be56-99f4-4ab8-a7d8-b12546fdc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.212199 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Volume 11db69bd-4bdb-42c4-9979-ab2bd0eb0bad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad', 'volume_size': 1}
Aug 06 21:21:11.212866 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] creating volume 'volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:11.213912 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:11.322345 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:11.322927 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:11.326797 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b20be56-99f4-4ab8-a7d8-b12546fdc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.333292 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148d1d6e-6f7f-4c77-9efc-2f41c88057d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:11.345203 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad (11db69bd-4bdb-42c4-9979-ab2bd0eb0bad): created successfully
Aug 06 21:21:11.353550 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148d1d6e-6f7f-4c77-9efc-2f41c88057d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:11.366638 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (339c0fed-62b1-4d61-84ee-341fa19ab90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:11.383376 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-10a7f41a-5088-4d7e-80b3-133a0ec21faa tempest-VolumesListAdminTestJSON-544701538 None] Created volume successfully.
Aug 06 21:21:12.355199 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:12.401919 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Flow 'volume_create_manager' (feb85f7a-c95d-4f8c-9667-abe04eaf4868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:12.413330 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b21e4b-401b-4e38-ab8d-2cca42c58fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.439316 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b21e4b-401b-4e38-ab8d-2cca42c58fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-33617521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c219f818-f17f-4dee-903c-d7b1404def96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af8471e400e24dd7a29c5bbb042ac0b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:12Z,use_quota=True,user_id='8d1a2c57cf5840f7a1dcede60357580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.449908 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b04508-69e4-476c-8440-7c02e952aa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.455901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b04508-69e4-476c-8440-7c02e952aa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.468428 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410ecbd6-7a43-4c8e-a7fd-88a4c7becdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.474733 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (410ecbd6-7a43-4c8e-a7fd-88a4c7becdd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c219f818-f17f-4dee-903c-d7b1404def96', 'volume_name': 'volume-c219f818-f17f-4dee-903c-d7b1404def96', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.479787 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6853e5-0344-4011-8e87-54134d8c021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.486126 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6853e5-0344-4011-8e87-54134d8c021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.490905 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78fd6e3-0ee1-41a1-a079-b6bb52a87f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.492279 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Volume c219f818-f17f-4dee-903c-d7b1404def96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c219f818-f17f-4dee-903c-d7b1404def96', 'volume_size': 1}
Aug 06 21:21:12.492826 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] creating volume 'volume-c219f818-f17f-4dee-903c-d7b1404def96' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:12.493663 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:12.567788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:12.596225 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Flow 'volume_create_manager' (cb2435af-9644-4af4-8021-cff25b10760c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:12.606075 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2c326d-8085-4361-8200-d10c360ef6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.633882 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2c326d-8085-4361-8200-d10c360ef6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-630059615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e1b6e4f9-5e75-425c-a886-c5d48ccddf64,host='ncdv-master-1@ceph#ceph',id=1b1a465b-1ab0-4d5a-8bc6-3ea820885154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='439dbec3c4864b389b7c74741be34702',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:12Z,use_quota=True,user_id='3aa861378d3649ed8115c02e205e70b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(012bf3ee-cf89-46c2-b066-0ab08891bb00),volume_type_id=012bf3ee-cf89-46c2-b066-0ab08891bb00)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.641107 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feece665-3683-44d7-814b-fd43c81f214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.647187 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feece665-3683-44d7-814b-fd43c81f214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.656838 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f1ea99-29ad-4f6b-93c1-f776015c5fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.659364 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64f1ea99-29ad-4f6b-93c1-f776015c5fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1a465b-1ab0-4d5a-8bc6-3ea820885154', 'volume_name': 'volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.685331 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074703c-a3a0-470d-a37c-8543fe48d805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.692261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6074703c-a3a0-470d-a37c-8543fe48d805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.699333 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787ba275-197f-46bc-a183-52a71cc2a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.701072 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Volume 1b1a465b-1ab0-4d5a-8bc6-3ea820885154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154', 'volume_size': 1}
Aug 06 21:21:12.702482 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] creating volume 'volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:12.703359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:12.807405 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:12.808067 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:12.812470 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d78fd6e3-0ee1-41a1-a079-b6bb52a87f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c219f818-f17f-4dee-903c-d7b1404def96', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.818786 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f523bd6b-34c2-44ad-a8c0-c03aa8b8c106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.844843 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Volume volume-c219f818-f17f-4dee-903c-d7b1404def96 (c219f818-f17f-4dee-903c-d7b1404def96): created successfully
Aug 06 21:21:12.857016 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f523bd6b-34c2-44ad-a8c0-c03aa8b8c106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.867081 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Flow 'volume_create_manager' (feb85f7a-c95d-4f8c-9667-abe04eaf4868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:12.884339 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:12.885749 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:12.890121 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787ba275-197f-46bc-a183-52a71cc2a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.894985 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459e3082-1df7-4e12-9fbf-1829eabd66d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:12.908080 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3bdf9e1e-da5d-4206-bf3e-dafe8697cfc1 tempest-VolumesNegativeTest-1659341584 None] Created volume successfully.
Aug 06 21:21:12.913576 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Volume volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154 (1b1a465b-1ab0-4d5a-8bc6-3ea820885154): created successfully
Aug 06 21:21:12.925740 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459e3082-1df7-4e12-9fbf-1829eabd66d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:12.932350 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Flow 'volume_create_manager' (cb2435af-9644-4af4-8021-cff25b10760c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:12.942643 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ac433dee-5c6c-4824-a383-6426e0bee16a tempest-GroupsV314Test-1342897340 None] Created volume successfully.
Aug 06 21:21:12.949621 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=56,cinder:INSERT=4,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:12.973062 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:12.993263 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (f87834cf-5a0b-49ee-972d-ba50ee717b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:12.999764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52138db1-1b02-4e88-b21d-6a846a9529d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.019337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52138db1-1b02-4e88-b21d-6a846a9529d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1857708380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dd99b48c-0395-4099-b4d7-6cf0e375612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d1d87d67b04288b9180302370543a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:13Z,use_quota=True,user_id='28d291870b6444a79541df94ae90cec5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.024563 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e68e4e-cf19-4799-99fd-954f804a71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.029507 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e68e4e-cf19-4799-99fd-954f804a71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.034767 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee03ac-0903-490e-8077-d090554459ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.038745 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aee03ac-0903-490e-8077-d090554459ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd99b48c-0395-4099-b4d7-6cf0e375612c', 'volume_name': 'volume-dd99b48c-0395-4099-b4d7-6cf0e375612c', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.043524 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c146902-0adc-4618-b76c-e4868b3dd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.047632 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c146902-0adc-4618-b76c-e4868b3dd989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.052115 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9f5850-2ee5-4724-bd79-4a966cf65ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.053161 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Volume dd99b48c-0395-4099-b4d7-6cf0e375612c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd99b48c-0395-4099-b4d7-6cf0e375612c', 'volume_size': 1}
Aug 06 21:21:13.053545 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] creating volume 'volume-dd99b48c-0395-4099-b4d7-6cf0e375612c' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:13.054285 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:13.156213 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:13.156566 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:13.161481 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a9f5850-2ee5-4724-bd79-4a966cf65ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd99b48c-0395-4099-b4d7-6cf0e375612c', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.167733 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab48b73-727b-47a0-abc2-1875a1754c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:13.178735 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-dd99b48c-0395-4099-b4d7-6cf0e375612c (dd99b48c-0395-4099-b4d7-6cf0e375612c): created successfully
Aug 06 21:21:13.184311 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab48b73-727b-47a0-abc2-1875a1754c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:13.191938 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Flow 'volume_create_manager' (f87834cf-5a0b-49ee-972d-ba50ee717b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:13.201971 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b1166622-7d63-40be-bfdf-ba645a979d2b tempest-VolumesListAdminTestJSON-544701538 None] Created volume successfully.
Aug 06 21:21:14.193287 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:14.287232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] creating snapshot='volume-a74562c7-0308-4d69-a389-9490ed5b5cf4.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:21:14.746113 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] cloning 'volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154@volume-a74562c7-0308-4d69-a389-9490ed5b5cf4.clone_snap' to 'volume-a74562c7-0308-4d69-a389-9490ed5b5cf4' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:21:14.900102 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] Volume volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:14.911156 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:14.911774 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:14.944318 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:21:15.035688 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-203f7e5c-ad9f-422e-8553-748ba1614d71 tempest-GroupsV314Test-1342897340 None] Create group from source-group-e1b6e4f9-5e75-425c-a886-c5d48ccddf64 completed successfully.
Aug 06 21:21:15.079726 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:15.101437 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Flow 'volume_create_manager' (51ba76cf-8210-4d8a-8eed-cb85ebd5c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:15.109185 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb90129b-227a-435d-8bc5-846765353b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.128034 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb90129b-227a-435d-8bc5-846765353b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8b1db3f0-c1ec-4300-a890-db9ec9a49497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30849d2db00549bdb8a4a42e56594598',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:15Z,use_quota=True,user_id='99f6921ccf8a443d89e62259402b415a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.139988 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243abb23-afe9-4eb4-8b80-4eed67eb6ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.146094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243abb23-afe9-4eb4-8b80-4eed67eb6ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.155976 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69093d14-0466-43fe-9326-b80554aeb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.161526 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69093d14-0466-43fe-9326-b80554aeb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b1db3f0-c1ec-4300-a890-db9ec9a49497', 'volume_name': 'volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.167085 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52af0529-9346-44cc-992e-feb5c6111f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.172045 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52af0529-9346-44cc-992e-feb5c6111f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.176643 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cf7da9-c459-4df0-96fd-11bb0965b594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.177632 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Volume 8b1db3f0-c1ec-4300-a890-db9ec9a49497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497', 'volume_size': 1}
Aug 06 21:21:15.178020 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] creating volume 'volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:15.178691 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:15.281644 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:15.282325 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:15.286403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81cf7da9-c459-4df0-96fd-11bb0965b594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.291712 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d451bec9-ac06-405b-b9f6-51fadde023e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:15.312861 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Volume volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497 (8b1db3f0-c1ec-4300-a890-db9ec9a49497): created successfully
Aug 06 21:21:15.317197 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d451bec9-ac06-405b-b9f6-51fadde023e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:15.324664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Flow 'volume_create_manager' (51ba76cf-8210-4d8a-8eed-cb85ebd5c473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:15.337861 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-208c30b7-478d-4c8b-9c7d-9ba48c4f4379 tempest-VolumesListAdminTestJSON-1806094298 None] Created volume successfully.
Aug 06 21:21:15.876826 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:15.964160 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:15.977167 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] deleting rbd volume volume-a74562c7-0308-4d69-a389-9490ed5b5cf4 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:16.111497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Acquiring lock "cinder-8b1db3f0-c1ec-4300-a890-db9ec9a49497-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:16.133332 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Lock "cinder-8b1db3f0-c1ec-4300-a890-db9ec9a49497-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:16.176521 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:16.238718 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:16.240130 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Volume volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:16.252746 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] deleting rbd volume volume-8b1db3f0-c1ec-4300-a890-db9ec9a49497 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:16.274193 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Acquiring lock "cinder-dd99b48c-0395-4099-b4d7-6cf0e375612c-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:16.278467 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:21:16.300573 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Volume volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:16.301837 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] deleting parent snapshot volume-a74562c7-0308-4d69-a389-9490ed5b5cf4.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:21:16.824557 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-dd99b48c-0395-4099-b4d7-6cf0e375612c-delete_volume" acquired by "delete_volume" :: waited 0.537s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:16.883525 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=68,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:16.912704 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Created reservations ['75fe4491-d2d6-44e4-a7bc-a42461b6f94b', '421912fd-8b98-4c0f-94ea-f018e7709faf', '8594b3f8-16fe-47bf-b8e5-30442be000ee', 'b2493983-6c12-45c0-8681-87536500f3fc'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:16.925926 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Created reservations ['2c226564-7fdb-4dcf-a80e-96e02834ab42'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:16.937961 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.023599 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:17.024092 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-dd99b48c-0395-4099-b4d7-6cf0e375612c is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:17.034206 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] deleting rbd volume volume-dd99b48c-0395-4099-b4d7-6cf0e375612c {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:17.122916 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2114621855 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2114621855, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:21:17.123891 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2114621855 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2114621855, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:21:17.160877 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.221513 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.300243 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:17.307486 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Deleted volume successfully.
Aug 06 21:21:17.337286 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-ceba2d0e-dfe9-4e7b-abed-f90be03fde67 tempest-VolumesListAdminTestJSON-1806094298 None] Lock "cinder-8b1db3f0-c1ec-4300-a890-db9ec9a49497-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:17.340647 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Created reservations ['e74c34a5-2d5a-4129-9f3d-6f10d2d0c749', 'ae36820d-8c9f-492f-85fe-292561660c22', 'b5ccc706-5d35-4139-b25e-3d3044b7a7e9', 'ba2a105f-aa9b-4fdb-90e5-654d906c6ff2'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:17.492188 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Created reservations ['3c1ba953-7795-404c-87f2-5d9101797479', '25c6c2ec-4376-4aac-be54-1b6a47d0658d', '6b3b838c-1ca8-4a66-a863-d475784ca715', '235671fe-720a-4c3a-99bc-45ceb60802cd'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:17.561081 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=29,cinder:SELECT=63,cinder:DELETE=2,cinder:INSERT=6 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:17.567850 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.638876 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.706675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:17.721324 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Deleted volume successfully.
Aug 06 21:21:17.770710 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-128db3fc-e895-4b60-8584-dcc2b9c64d47 tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-dd99b48c-0395-4099-b4d7-6cf0e375612c-delete_volume" released by "delete_volume" :: held 0.959s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:17.796208 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.863783 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:17.946380 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:17.951919 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-d7d4295c-3e33-44a3-a8c6-4866391caaee tempest-GroupsV314Test-1342897340 None] Delete group completed successfully.
Aug 06 21:21:18.525679 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Acquiring lock "cinder-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:18.547102 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:18.612149 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:18.712205 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:18.712968 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] Volume volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:18.735100 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] deleting rbd volume volume-1b1a465b-1ab0-4d5a-8bc6-3ea820885154 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:18.756910 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:18.859987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:18.861063 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:18.867988 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] deleting rbd volume volume-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:19.124658 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] Created reservations ['93ccb347-fd9f-4a37-9791-bfd220ed5173'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:19.212863 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] Created reservations ['43b2da17-db0b-4f22-a5e6-a8bd4e42cf55', '2c9b0e0e-8be5-4eba-b156-298b5b511f27', 'b73ad176-9046-4fc6-8dc0-a2c4290f91c2', '64b27126-a3f6-411e-9844-321e3480ee0e'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:19.268712 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Created reservations ['9d9528a7-994a-40e2-b97d-0f744403a630', '877393cf-0ba2-4397-b9a5-f813b8cbcfde', 'bd186126-a66d-4395-a745-f3b5a51842df', '47f18431-3c84-4033-ab6b-3e791d13e230'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:19.366602 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=45,cinder:SELECT=49,cinder:INSERT=5,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:19.384083 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:19.434267 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:19.478852 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:19.487211 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0214310c-dbaf-4176-9b8d-d3da590cae35 tempest-GroupsV314Test-1342897340 None] Delete group completed successfully.
Aug 06 21:21:19.490701 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:19.534887 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:19.587107 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:19.593376 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Deleted volume successfully.
Aug 06 21:21:19.609475 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6541548b-7cb6-41b1-a434-471ce8e25d3d tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-11db69bd-4bdb-42c4-9979-ab2bd0eb0bad-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:19.863095 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Acquiring lock "cinder-3be9895e-456a-4b08-94c6-e045205b3acb-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:19.883369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-3be9895e-456a-4b08-94c6-e045205b3acb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:19.954900 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:20.010539 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:20.011103 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Volume volume-3be9895e-456a-4b08-94c6-e045205b3acb is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:20.018974 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] deleting rbd volume volume-3be9895e-456a-4b08-94c6-e045205b3acb {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:20.291605 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Created reservations ['a0122511-076c-4dbd-a714-75dddf0f0552', 'cf04e8b2-0794-413a-8c5f-6f05c43a344c', 'e0555464-61dc-4cbc-9561-3a3361150763', '9eb6eddb-b683-46b7-a958-bb43a892d537'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:20.368005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:20.460215 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:20.513777 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:20.520782 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Deleted volume successfully.
Aug 06 21:21:20.540366 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e4cf0e21-67b7-4a16-9c41-f9122eadb38d tempest-VolumesListAdminTestJSON-544701538 None] Lock "cinder-3be9895e-456a-4b08-94c6-e045205b3acb-delete_volume" released by "delete_volume" :: held 0.657s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:20.720266 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:21:20.720961 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:20.791970 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:20.843923 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:26.000175 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:26.027108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Flow 'volume_create_manager' (7b5321d7-5a76-4032-9e4d-bd95284cf9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:26.069913 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0874dc19-aa31-4e6e-bfe4-6ab142310163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.092033 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0874dc19-aa31-4e6e-bfe4-6ab142310163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1778951046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=d432b5a2-a2bd-4661-a7ca-c0a17f902af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd235081a2584c6986aa088c734bd170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:26Z,use_quota=True,user_id='a0987f19a34d4275a727d1509fb6cb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.098132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb84d74-1f3c-4ef2-8ae8-9bcb2f972b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.102262 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb84d74-1f3c-4ef2-8ae8-9bcb2f972b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.108070 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505f80a1-e6b1-4709-b34b-ea429a03d7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.145337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:26.174305 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Flow 'volume_create_manager' (33e63f9b-b494-45d0-8a38-9b37bd30da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:26.181116 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73deae9c-f878-4a99-98a4-065f189358ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.216949 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73deae9c-f878-4a99-98a4-065f189358ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1678713592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=63640147-d469-45de-a695-7a967ebce916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e193f7f7140b884288209cc291d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:26Z,use_quota=True,user_id='8a3721904bb847d18a18d272a7d34949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.222969 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d196db62-3262-49ac-886b-ddd8eb64eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.227526 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d196db62-3262-49ac-886b-ddd8eb64eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.237056 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8f8f87-f61f-442d-88d7-6df92333fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.241498 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8f8f87-f61f-442d-88d7-6df92333fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63640147-d469-45de-a695-7a967ebce916', 'volume_name': 'volume-63640147-d469-45de-a695-7a967ebce916', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.247224 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ee5884-8318-40f3-92ea-40a8b34f8f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.251385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2ee5884-8318-40f3-92ea-40a8b34f8f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.255956 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558c2ac-899d-4e02-ab2f-a3f800887421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.257039 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Volume 63640147-d469-45de-a695-7a967ebce916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63640147-d469-45de-a695-7a967ebce916', 'volume_size': 1}
Aug 06 21:21:26.257429 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] creating volume 'volume-63640147-d469-45de-a695-7a967ebce916' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:26.258197 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:26.350467 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505f80a1-e6b1-4709-b34b-ea429a03d7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd432b5a2-a2bd-4661-a7ca-c0a17f902af9', 'volume_name': 'volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a034610>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.361288 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50369cb4-cd16-4e3f-ac69-a189d77ff0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.366053 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50369cb4-cd16-4e3f-ac69-a189d77ff0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.373911 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada3d2a-154e-491b-8671-cf5318b2fefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.375107 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Volume d432b5a2-a2bd-4661-a7ca-c0a17f902af9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a034610>}
Aug 06 21:21:26.375877 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Cloning d432b5a2-a2bd-4661-a7ca-c0a17f902af9 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:21:26.376801 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:26.389396 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:26.390078 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:26.395473 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d558c2ac-899d-4e02-ab2f-a3f800887421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63640147-d469-45de-a695-7a967ebce916', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.400195 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b239c2d9-4fbd-4960-bdaf-67ed0741e426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:26.411090 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.034s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:26.417890 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Volume volume-63640147-d469-45de-a695-7a967ebce916 (63640147-d469-45de-a695-7a967ebce916): created successfully
Aug 06 21:21:26.423086 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b239c2d9-4fbd-4960-bdaf-67ed0741e426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:26.430027 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Flow 'volume_create_manager' (33e63f9b-b494-45d0-8a38-9b37bd30da96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:26.443096 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 26, 416098)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:26.443888 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:26.444487 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:21:26.447440 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-77573463-e152-402a-af77-b13bc2e3ad75 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Created volume successfully.
Aug 06 21:21:26.455882 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:26.457333 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:21:26.463936 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 26, 461275)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:26.464663 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:26.468106 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:21:26.489261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:26.577259 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] creating snapshot='volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:21:26.969203 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9.clone_snap' to 'volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:21:27.200301 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:27.201483 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:27.201874 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:27.238448 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:21:27.239284 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Marking volume d432b5a2-a2bd-4661-a7ca-c0a17f902af9 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:21:27.252782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to d432b5a2-a2bd-4661-a7ca-c0a17f902af9. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:21:27.253428 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Creating volume glance metadata for volume d432b5a2-a2bd-4661-a7ca-c0a17f902af9 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:21:27.276123 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=55,cinder:UPDATE=33,cinder:INSERT=11,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:27.394350 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bada3d2a-154e-491b-8671-cf5318b2fefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475a034610>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:27.406394 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80fa59-9fde-4f73-9c77-ff2338c3a930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:27.428455 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Volume volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9 (d432b5a2-a2bd-4661-a7ca-c0a17f902af9): created successfully
Aug 06 21:21:27.462607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b80fa59-9fde-4f73-9c77-ff2338c3a930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:27.468749 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Flow 'volume_create_manager' (7b5321d7-5a76-4032-9e4d-bd95284cf9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:27.529482 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-67a92995-fecb-423a-a6b5-ced1923bb0a9 tempest-VolumesImageMetadata-611945821 None] Created volume successfully.
Aug 06 21:21:27.557971 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3b7c518e-40e5-4960-9591-9d632fc59881 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:28.082026 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3b7c518e-40e5-4960-9591-9d632fc59881 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Create snapshot completed successfully
Aug 06 21:21:28.473005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Acquiring lock "cinder-d432b5a2-a2bd-4661-a7ca-c0a17f902af9-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:28.514694 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Lock "cinder-d432b5a2-a2bd-4661-a7ca-c0a17f902af9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:28.604854 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:28.734985 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:28.747535 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] deleting rbd volume volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:29.133309 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:21:29.205669 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] deleting parent snapshot volume-d432b5a2-a2bd-4661-a7ca-c0a17f902af9.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:21:30.102705 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Acquiring lock "cinder-fb542933-2454-4e54-aed7-f3f8b145638c-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:30.129737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Lock "cinder-fb542933-2454-4e54-aed7-f3f8b145638c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:30.131639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:30.309174 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Created reservations ['d10948d0-f4f8-405c-a6f7-d75e040de04e', '59a39471-84ab-415f-a1fb-a5fed7fdad99', 'c1eba81e-8486-40d6-b458-563355d8b798', '36b67468-3f92-40bb-b0f9-4939974f7b8f'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:30.391416 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:30.462601 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:30.541391 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:30.558996 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Deleted volume successfully.
Aug 06 21:21:30.587458 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-dae6de97-44e4-4adb-93c2-4acd338d7bc4 tempest-VolumesImageMetadata-611945821 None] Lock "cinder-d432b5a2-a2bd-4661-a7ca-c0a17f902af9-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:31.161309 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Created reservations ['2ff79969-aa47-4b0b-bed6-34987a02ce65', '2496e901-36f8-4566-a51f-af7b69874b16', '7b5d7818-d23d-4e3d-b86b-70d5658ac2ec', '3ebeb471-1d68-4c68-9b46-f1cb8bbb2a39'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:31.213758 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:DELETE=3,cinder:SELECT=63,cinder:UPDATE=20,cinder:INSERT=14 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:31.223763 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Delete snapshot completed successfully.
Aug 06 21:21:31.237711 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-893a6e86-b122-4f44-92e7-5c9684106682 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Lock "cinder-fb542933-2454-4e54-aed7-f3f8b145638c-delete_snapshot" released by "delete_snapshot" :: held 1.108s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:31.663526 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Acquiring lock "cinder-63640147-d469-45de-a695-7a967ebce916-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:31.688263 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Lock "cinder-63640147-d469-45de-a695-7a967ebce916-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:31.772973 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:31.897607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:31.898373 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Volume volume-63640147-d469-45de-a695-7a967ebce916 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:31.906770 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] deleting rbd volume volume-63640147-d469-45de-a695-7a967ebce916 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:32.243805 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Created reservations ['06f59865-0f48-433f-96cf-2dc7df2572c4', '7a36854c-b75b-40b0-b4ab-c7b74b15be8e', '9c3ad9cd-ba6a-4bdb-94a8-a67ad3d034a3', '9c8ee331-191d-4bd1-87d8-fb2be56c3958'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:32.318284 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:32.392940 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:32.517686 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:32.523412 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Deleted volume successfully.
Aug 06 21:21:32.588036 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-44ddf3c4-cf25-437b-8e12-69a0f34e0421 tempest-VolumeSnapshotQuotasNegativeTestJSON-2003592015 None] Lock "cinder-63640147-d469-45de-a695-7a967ebce916-delete_volume" released by "delete_volume" :: held 0.900s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:36.941382 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:36.964542 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Flow 'volume_create_manager' (f0c882d6-20ee-4fcc-ba2a-9afb9fad0d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:36.971232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0a3d5f-26bd-456a-949a-ad6bb1efc878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:36.994322 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0a3d5f-26bd-456a-949a-ad6bb1efc878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1518440531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f5adaf89-1512-4f7e-9904-46f75cd0794e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfb3b91ed1294ea187812b7312601b27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:37Z,use_quota=True,user_id='65e64ff8f2b14f70b1b05327f691701e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.000348 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dce775-cb6d-4a2e-a175-e29f9df9f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:37.005169 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93dce775-cb6d-4a2e-a175-e29f9df9f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.011714 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096570d1-7841-4d58-94a6-004c1079f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:37.017130 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096570d1-7841-4d58-94a6-004c1079f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5adaf89-1512-4f7e-9904-46f75cd0794e', 'volume_name': 'volume-f5adaf89-1512-4f7e-9904-46f75cd0794e', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.022357 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8fe256-8130-4e66-b997-cbaa7e81d710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:37.033326 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf8fe256-8130-4e66-b997-cbaa7e81d710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.040947 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4fd4e6-ff4d-4c65-b1e7-32b233811e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:37.042061 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume f5adaf89-1512-4f7e-9904-46f75cd0794e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5adaf89-1512-4f7e-9904-46f75cd0794e', 'volume_size': 1}
Aug 06 21:21:37.043021 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] creating volume 'volume-f5adaf89-1512-4f7e-9904-46f75cd0794e' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:37.044196 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:37.132579 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:37.133426 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:37.140662 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e4fd4e6-ff4d-4c65-b1e7-32b233811e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5adaf89-1512-4f7e-9904-46f75cd0794e', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.146385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf03db03-4aa1-4784-b775-c658b3e96dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:37.159622 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume volume-f5adaf89-1512-4f7e-9904-46f75cd0794e (f5adaf89-1512-4f7e-9904-46f75cd0794e): created successfully
Aug 06 21:21:37.164359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf03db03-4aa1-4784-b775-c658b3e96dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:37.170802 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Flow 'volume_create_manager' (f0c882d6-20ee-4fcc-ba2a-9afb9fad0d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:37.179560 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f07f064e-4e58-400e-b726-12c938642489 tempest-AttachVolumeShelveTestJSON-1443103339 None] Created volume successfully.
Aug 06 21:21:38.497647 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:38.554119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Flow 'volume_create_manager' (0d8f9383-04d1-421c-b2ea-295482e831dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:38.566386 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908acf2e-f778-4313-9e5e-8a5f7d034fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.610958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908acf2e-f778-4313-9e5e-8a5f7d034fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-78323199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4353ecd7-e782-4994-b904-d40f15d56298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8806ae7e224ab38a578001b4f3bb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:38Z,use_quota=True,user_id='488f1f325be7406ca724054347d85129',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.631074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a05137-e834-4fdd-842d-15341d3363d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.645030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a05137-e834-4fdd-842d-15341d3363d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.650473 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c759868-f5b5-4aec-819f-3b3f4a1daa60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.654649 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c759868-f5b5-4aec-819f-3b3f4a1daa60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4353ecd7-e782-4994-b904-d40f15d56298', 'volume_name': 'volume-4353ecd7-e782-4994-b904-d40f15d56298', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.661819 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7121e1e2-d118-4dc0-948e-e28b011c48ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.682460 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7121e1e2-d118-4dc0-948e-e28b011c48ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.688292 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4352ef1-b47c-4f04-8a40-b8655ce10be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.689709 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Volume 4353ecd7-e782-4994-b904-d40f15d56298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4353ecd7-e782-4994-b904-d40f15d56298', 'volume_size': 1}
Aug 06 21:21:38.690249 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] creating volume 'volume-4353ecd7-e782-4994-b904-d40f15d56298' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:38.690800 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:38.770091 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Acquiring lock "cinder-c219f818-f17f-4dee-903c-d7b1404def96-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:38.795106 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Lock "cinder-c219f818-f17f-4dee-903c-d7b1404def96-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:38.819584 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:38.820381 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:38.828873 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4352ef1-b47c-4f04-8a40-b8655ce10be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4353ecd7-e782-4994-b904-d40f15d56298', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.834842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d264f0d6-9df6-4791-8493-bc91a09856dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:38.849717 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:INSERT=10,cinder:SELECT=55,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:38.862518 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Volume volume-4353ecd7-e782-4994-b904-d40f15d56298 (4353ecd7-e782-4994-b904-d40f15d56298): created successfully
Aug 06 21:21:38.868744 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d264f0d6-9df6-4791-8493-bc91a09856dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:38.897581 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Flow 'volume_create_manager' (0d8f9383-04d1-421c-b2ea-295482e831dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:38.913715 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:38.978412 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:38.978880 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Volume volume-c219f818-f17f-4dee-903c-d7b1404def96 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:38.985580 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] deleting rbd volume volume-c219f818-f17f-4dee-903c-d7b1404def96 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:38.988723 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-8eff5030-645f-4a8d-8177-acd68d002c9e tempest-VolumesMetadataTest-1383524537 None] Created volume successfully.
Aug 06 21:21:39.290863 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Created reservations ['bbccf750-09f9-41bf-a74d-6d97c06bd653', '8207ac14-354e-4669-a7ff-e69b88b7cc7c', '59a4d4e6-211a-42b7-98d7-43a16fc15454', '8d3015d3-c102-438a-bde4-fa06040f2e20'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:39.337997 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:39.377359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:39.442636 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:39.449123 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Deleted volume successfully.
Aug 06 21:21:39.464961 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-10f7b78d-1f7d-4972-bd25-ee24f7ca64e4 tempest-VolumesNegativeTest-1659341584 None] Lock "cinder-c219f818-f17f-4dee-903c-d7b1404def96-delete_volume" released by "delete_volume" :: held 0.670s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:40.185799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Acquiring lock "cinder-4353ecd7-e782-4994-b904-d40f15d56298-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:40.196563 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Lock "cinder-4353ecd7-e782-4994-b904-d40f15d56298-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:40.242842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:40.311877 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:40.312263 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Volume volume-4353ecd7-e782-4994-b904-d40f15d56298 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:40.318098 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] deleting rbd volume volume-4353ecd7-e782-4994-b904-d40f15d56298 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:40.628644 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Created reservations ['0a27b672-16f0-4636-9257-bf7c9f889637', '001706b4-5c9d-41c3-9687-d3b92f99d854', 'bb4e3c6e-a6c4-4fed-aadf-56dc791fc6f4', '23284c46-6fbc-4b0a-8f75-5f1204a6269c'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:40.721704 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:40.819033 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:40.883783 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:40.888092 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Deleted volume successfully.
Aug 06 21:21:40.907402 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9aceddca-931e-4863-aaf8-6aae9e5ba35f tempest-VolumesMetadataTest-1383524537 None] Lock "cinder-4353ecd7-e782-4994-b904-d40f15d56298-delete_volume" released by "delete_volume" :: held 0.711s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:41.377865 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:41.405527 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Flow 'volume_create_manager' (78ceff6f-e8d8-4475-b606-2542620a40f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:41.412363 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918e3a32-0780-475e-8372-1b77abaaeb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.431464 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (918e3a32-0780-475e-8372-1b77abaaeb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1113364891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0333a5d-dc30-4c18-b70a-642c50ead26b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd5da91b469e4b96a736fb25a6d30d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:41Z,use_quota=True,user_id='9e43dc88da334346b2f097d3a29646b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8684e85-6e0a-4912-b6a8-7deae99e986e),volume_type_id=d8684e85-6e0a-4912-b6a8-7deae99e986e)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.439117 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b7de9f-d5e7-4afe-aecf-a9325d23dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.443284 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b7de9f-d5e7-4afe-aecf-a9325d23dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.449001 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100de3a7-5706-4c36-b5e3-37f5ee10c73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.453158 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (100de3a7-5706-4c36-b5e3-37f5ee10c73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0333a5d-dc30-4c18-b70a-642c50ead26b', 'volume_name': 'volume-f0333a5d-dc30-4c18-b70a-642c50ead26b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.458293 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dd8a2c-7855-4c7e-9a18-21e8421de630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.462021 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40dd8a2c-7855-4c7e-9a18-21e8421de630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.467918 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65ef66-9ae2-4d56-a620-e0bf39676d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.468995 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Volume f0333a5d-dc30-4c18-b70a-642c50ead26b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0333a5d-dc30-4c18-b70a-642c50ead26b', 'volume_size': 1}
Aug 06 21:21:41.469396 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] creating volume 'volume-f0333a5d-dc30-4c18-b70a-642c50ead26b' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:41.470232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:41.531687 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] extra_specs: {} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:41.532059 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] extra_specs: {} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:41.536162 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd65ef66-9ae2-4d56-a620-e0bf39676d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0333a5d-dc30-4c18-b70a-642c50ead26b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.541009 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bb6325-fb7d-4cad-bdaf-8523f6bbbe82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:41.557156 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Volume volume-f0333a5d-dc30-4c18-b70a-642c50ead26b (f0333a5d-dc30-4c18-b70a-642c50ead26b): created successfully
Aug 06 21:21:41.564579 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1bb6325-fb7d-4cad-bdaf-8523f6bbbe82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:41.572220 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Flow 'volume_create_manager' (78ceff6f-e8d8-4475-b606-2542620a40f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:41.583821 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-ca9819bd-265b-4f07-9339-c857e8997550 tempest-VolumeTypesAccessTest-878631431 None] Created volume successfully.
Aug 06 21:21:42.990943 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Acquiring lock "cinder-f0333a5d-dc30-4c18-b70a-642c50ead26b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:43.021178 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Lock "cinder-f0333a5d-dc30-4c18-b70a-642c50ead26b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:43.123812 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:43.225299 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:43.225893 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Volume volume-f0333a5d-dc30-4c18-b70a-642c50ead26b is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:43.238559 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] deleting rbd volume volume-f0333a5d-dc30-4c18-b70a-642c50ead26b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:43.368377 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:43.395422 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Flow 'volume_create_manager' (9c8a5ec7-cff8-45b9-9ded-f7ccb97d39d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:43.404163 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6d8f62-63da-4b92-9794-e1adb4435250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.428528 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f6d8f62-63da-4b92-9794-e1adb4435250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1654976829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=c69cba1d-792b-4630-b2b1-73212ca4700c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa632f6acea044ee9bdbb0da3ab88840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:43Z,use_quota=True,user_id='70d073ddaa5c406ea3a4311668d3b8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.434135 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe69cae-aee6-43c6-bd6c-10c3ceade7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.438442 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe69cae-aee6-43c6-bd6c-10c3ceade7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.444005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8720cb85-cef4-49d9-bdf6-588774c9f58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.448385 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8720cb85-cef4-49d9-bdf6-588774c9f58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c69cba1d-792b-4630-b2b1-73212ca4700c', 'volume_name': 'volume-c69cba1d-792b-4630-b2b1-73212ca4700c', 'volume_size': 2}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.453821 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0845a0-231c-4960-bf50-28d531812f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.458047 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd0845a0-231c-4960-bf50-28d531812f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.464373 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e19acd-58aa-4f7f-b60f-730160a7c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.465867 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Volume c69cba1d-792b-4630-b2b1-73212ca4700c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c69cba1d-792b-4630-b2b1-73212ca4700c', 'volume_size': 2}
Aug 06 21:21:43.466441 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] creating volume 'volume-c69cba1d-792b-4630-b2b1-73212ca4700c' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:43.467298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:43.546718 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:43.547721 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:43.552024 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18e19acd-58aa-4f7f-b60f-730160a7c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69cba1d-792b-4630-b2b1-73212ca4700c', 'volume_size': 2}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.556579 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf03e46f-2b6b-472d-9d3b-7c293b3c1e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:43.563415 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-78733719 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-78733719, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:21:43.564230 ncdv-master-1 cinder-volume[135688]: WARNING cinder.quota [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-78733719 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-78733719, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:21:43.577066 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Volume volume-c69cba1d-792b-4630-b2b1-73212ca4700c (c69cba1d-792b-4630-b2b1-73212ca4700c): created successfully
Aug 06 21:21:43.581503 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf03e46f-2b6b-472d-9d3b-7c293b3c1e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:43.587249 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Flow 'volume_create_manager' (9c8a5ec7-cff8-45b9-9ded-f7ccb97d39d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:43.602854 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3257b6f9-96bc-48d2-b03c-b5eb8b640052 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Created volume successfully.
Aug 06 21:21:43.607569 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Created reservations ['e1840fc9-18d7-4210-b796-9af1e60325af', 'fa575c19-e3d2-46a0-8040-69744e972c5a', '3106b564-f596-44af-bf78-0e9fb44e7a22', 'dfef3444-eb16-4464-a14e-908560620504'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:43.611854 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:43.663414 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:43.719379 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:43.753802 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:43.759421 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Deleted volume successfully.
Aug 06 21:21:43.775491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-05b1d842-d2aa-46ee-81fc-484d62a7baf7 tempest-VolumeTypesAccessTest-878631431 None] Lock "cinder-f0333a5d-dc30-4c18-b70a-642c50ead26b-delete_volume" released by "delete_volume" :: held 0.754s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:44.667869 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b6fbc50f-b902-47e7-b1df-10cb76a57299 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:45.871870 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=48,cinder:INSERT=8,cinder:UPDATE=39,cinder:DELETE=5 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:45.883425 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b6fbc50f-b902-47e7-b1df-10cb76a57299 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Create snapshot completed successfully
Aug 06 21:21:46.207446 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:46.227512 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Flow 'volume_create_manager' (54f76351-d135-4cee-ba06-1819cfb49de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:46.234340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758c448-e1f5-40da-ba3a-aec31b515b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.251988 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8758c448-e1f5-40da-ba3a-aec31b515b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-578237780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=f21b643f-eab0-48cf-bb32-4af5813cd711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3663b13dd84f4d87954147b0fea50778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:46Z,use_quota=True,user_id='0388449c508e47c4a90a6131b8dc0997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.257645 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62725078-cee9-47ba-8e1a-f3fbb9bd7d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.262791 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62725078-cee9-47ba-8e1a-f3fbb9bd7d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.267969 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eb6894-44a5-47e9-b4eb-e0949fd8d7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.272288 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89eb6894-44a5-47e9-b4eb-e0949fd8d7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21b643f-eab0-48cf-bb32-4af5813cd711', 'volume_name': 'volume-f21b643f-eab0-48cf-bb32-4af5813cd711', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.277402 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb6b0a5-2318-4e27-b4c8-35e3ed659f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.281451 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb6b0a5-2318-4e27-b4c8-35e3ed659f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.286108 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b41399-5fec-46a7-95c2-5c31882ce0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.287230 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Volume f21b643f-eab0-48cf-bb32-4af5813cd711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21b643f-eab0-48cf-bb32-4af5813cd711', 'volume_size': 1}
Aug 06 21:21:46.287627 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] creating volume 'volume-f21b643f-eab0-48cf-bb32-4af5813cd711' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:46.288405 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:46.357837 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:46.358135 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:46.362346 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27b41399-5fec-46a7-95c2-5c31882ce0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21b643f-eab0-48cf-bb32-4af5813cd711', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.368965 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a7933f-5e35-4262-acb8-6f068e5ad123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.381013 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Volume volume-f21b643f-eab0-48cf-bb32-4af5813cd711 (f21b643f-eab0-48cf-bb32-4af5813cd711): created successfully
Aug 06 21:21:46.384707 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a7933f-5e35-4262-acb8-6f068e5ad123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.390651 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Flow 'volume_create_manager' (54f76351-d135-4cee-ba06-1819cfb49de7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:46.399488 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-cb4c63fa-cadf-43e4-abf2-fc00aa0d7cf0 tempest-VolumesTransfersTest-1242675292 None] Created volume successfully.
Aug 06 21:21:46.581895 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:46.601471 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Flow 'volume_create_manager' (34a94ed5-c65c-493e-ba27-147098a9de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:46.608664 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b065df-ff82-4a67-ba17-06c741cb4619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.626067 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b065df-ff82-4a67-ba17-06c741cb4619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-837569134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=ab66bf72-7af4-406e-8982-1355bc9774b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c91f85759d6422ebf57d9c7258d09e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:47Z,use_quota=True,user_id='c42c4a8438ea4349bac43e6a250d548b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.631443 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6682096e-4548-405b-8197-45aa89a0b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.635945 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6682096e-4548-405b-8197-45aa89a0b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.641897 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f85a749-1f61-44f5-94b0-17089557626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.645937 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f85a749-1f61-44f5-94b0-17089557626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab66bf72-7af4-406e-8982-1355bc9774b0', 'volume_name': 'volume-ab66bf72-7af4-406e-8982-1355bc9774b0', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.650954 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad4f7c0-2a66-4f2d-a324-dd0177d37466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.655565 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad4f7c0-2a66-4f2d-a324-dd0177d37466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.660250 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdd98fc-3fa6-413d-a1f1-ab9b80f2567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.661388 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Volume ab66bf72-7af4-406e-8982-1355bc9774b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab66bf72-7af4-406e-8982-1355bc9774b0', 'volume_size': 1}
Aug 06 21:21:46.661762 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] creating volume 'volume-ab66bf72-7af4-406e-8982-1355bc9774b0' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:46.662396 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:46.766539 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:46.767322 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:46.771117 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbdd98fc-3fa6-413d-a1f1-ab9b80f2567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab66bf72-7af4-406e-8982-1355bc9774b0', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.775344 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f94043a-c086-42d9-a6b6-1f8bd831577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:46.789019 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Volume volume-ab66bf72-7af4-406e-8982-1355bc9774b0 (ab66bf72-7af4-406e-8982-1355bc9774b0): created successfully
Aug 06 21:21:46.789441 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f94043a-c086-42d9-a6b6-1f8bd831577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:46.797140 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Flow 'volume_create_manager' (34a94ed5-c65c-493e-ba27-147098a9de93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:46.806198 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-73238807-6f80-4db1-af1c-66e8d4cf860e tempest-AbsoluteLimitsTests-105526303 None] Created volume successfully.
Aug 06 21:21:46.857726 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Acquiring lock "cinder-995cadbb-3e6a-424b-98eb-6f59649962d2-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:46.878197 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Lock "cinder-995cadbb-3e6a-424b-98eb-6f59649962d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:46.881105 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:47.869248 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Acquiring lock "cinder-ab66bf72-7af4-406e-8982-1355bc9774b0-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:47.891339 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Lock "cinder-ab66bf72-7af4-406e-8982-1355bc9774b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:47.926388 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Created reservations ['3fa33b2e-b572-4769-bafb-29f601746a31', 'ead7df4f-dc07-42f2-a805-a8066ea0891a', '056f8f18-2ca6-4a4a-ab22-5cf412397b2b', '6d568335-b071-4a69-95c6-4a3e2893b653'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:47.988958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.099847 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:48.100481 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Volume volume-ab66bf72-7af4-406e-8982-1355bc9774b0 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:48.109224 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] deleting rbd volume volume-ab66bf72-7af4-406e-8982-1355bc9774b0 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:48.148141 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Acquiring lock "cinder-c69cba1d-792b-4630-b2b1-73212ca4700c-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:48.177330 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Lock "cinder-c69cba1d-792b-4630-b2b1-73212ca4700c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:48.188234 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Delete snapshot completed successfully.
Aug 06 21:21:48.201906 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-f7b51bb2-7195-46d5-9003-86aad0c18830 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Lock "cinder-995cadbb-3e6a-424b-98eb-6f59649962d2-delete_snapshot" released by "delete_snapshot" :: held 1.324s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:48.260762 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.348119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:48.348763 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Volume volume-c69cba1d-792b-4630-b2b1-73212ca4700c is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:48.356880 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] deleting rbd volume volume-c69cba1d-792b-4630-b2b1-73212ca4700c {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:48.389294 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-92fb66cf-d208-4dfa-a1a2-9b50f872c303 tempest-VolumesTransfersTest-1882641221 None] Transfer volume completed successfully.
Aug 06 21:21:48.535238 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Created reservations ['60e7f297-35bd-47a1-9d93-9b0d5763dc81', 'ca540d03-62f8-4058-a333-9c869fd17c26', '1492ffc9-216e-43f9-b6b6-e933034b049f', '2b55836d-0a47-426d-8f2b-f5819200d4fa'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:48.646298 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.705854 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.758955 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:48.773183 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Deleted volume successfully.
Aug 06 21:21:48.805009 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Created reservations ['9e4e677b-4127-4f30-aee1-d1b4b85e936d', '513ab7d4-f368-4a80-a77e-dc5db8d10565', '5412ca68-427e-44e9-9d0d-c3036faef5bc', '36301bc6-cd0a-442e-bf0a-daf08109d1ce'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:48.805718 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-0d459c4b-3ba4-4f4f-8a12-9bd68515225b tempest-AbsoluteLimitsTests-105526303 None] Lock "cinder-ab66bf72-7af4-406e-8982-1355bc9774b0-delete_volume" released by "delete_volume" :: held 0.914s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:48.870983 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.928169 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:48.971358 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:48.976765 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Deleted volume successfully.
Aug 06 21:21:48.991888 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-5d484781-8d23-4e93-915b-780cdd4e2dd2 tempest-VolumesSnapshotNegativeTestJSON-231092031 None] Lock "cinder-c69cba1d-792b-4630-b2b1-73212ca4700c-delete_volume" released by "delete_volume" :: held 0.814s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:49.107737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Acquiring lock "cinder-f21b643f-eab0-48cf-bb32-4af5813cd711-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:49.119246 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Lock "cinder-f21b643f-eab0-48cf-bb32-4af5813cd711-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:49.153987 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:49.217710 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:49.218231 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Volume volume-f21b643f-eab0-48cf-bb32-4af5813cd711 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:49.222935 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] deleting rbd volume volume-f21b643f-eab0-48cf-bb32-4af5813cd711 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:49.453649 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=29,cinder:SELECT=60,cinder:DELETE=4,cinder:INSERT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:49.520335 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Created reservations ['ecb7e3eb-20b6-47d3-a22a-7a83968043c0', 'd6349d5f-08de-469c-ae54-16763c4788dc', 'cbad8d1e-3ab4-4744-b590-50efa4610408', '6ba88f49-9f53-40e7-880e-973fed348488'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:49.662364 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:49.779958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:49.828398 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:49.841659 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Deleted volume successfully.
Aug 06 21:21:49.859614 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-6cb4c5e1-56d6-4209-994d-951b2ba44a51 tempest-VolumesTransfersTest-115173758 None] Lock "cinder-f21b643f-eab0-48cf-bb32-4af5813cd711-delete_volume" released by "delete_volume" :: held 0.740s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:49.864626 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:49.885255 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (f7889fbb-a573-467b-aabb-e6ce6e7a2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:49.892387 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0407c3-72ce-4f39-b9cd-2d0bd1079356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:49.908366 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0407c3-72ce-4f39-b9cd-2d0bd1079356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1089791414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=70351e39-2844-49d7-b0b4-174a1a6f5120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ec7ca33064d058e17d7f10e583d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:50Z,use_quota=True,user_id='2a93852c0d284270bac8bfc209dc8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:49.913491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201bd99d-18f8-4972-aa2f-2196bb36af18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:49.917508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (201bd99d-18f8-4972-aa2f-2196bb36af18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:49.922641 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b118f1c-c385-4f81-ab31-1f63d13794c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:50.013938 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b118f1c-c385-4f81-ab31-1f63d13794c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70351e39-2844-49d7-b0b4-174a1a6f5120', 'volume_name': 'volume-70351e39-2844-49d7-b0b4-174a1a6f5120', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c3ea7f0>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:50.019094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a18331c-f5fe-434a-8a0b-3f0998dd5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:50.023453 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a18331c-f5fe-434a-8a0b-3f0998dd5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:50.028522 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34af7b43-f284-4b53-b684-f81c5bb91461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:50.029658 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Volume 70351e39-2844-49d7-b0b4-174a1a6f5120: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70351e39-2844-49d7-b0b4-174a1a6f5120', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c3ea7f0>}
Aug 06 21:21:50.030268 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Cloning 70351e39-2844-49d7-b0b4-174a1a6f5120 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:21:50.030990 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:50.039613 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:50.052696 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 50, 44449)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:50.053119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:50.053529 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:21:50.058359 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.019s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:50.059247 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:21:50.065661 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 50, 63103)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:50.066265 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:50.066896 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:21:50.069903 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=56,cinder:UPDATE=34,cinder:DELETE=1,cinder:INSERT=9 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:50.080244 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:50.133035 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] creating snapshot='volume-70351e39-2844-49d7-b0b4-174a1a6f5120.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:21:50.875694 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-70351e39-2844-49d7-b0b4-174a1a6f5120.clone_snap' to 'volume-70351e39-2844-49d7-b0b4-174a1a6f5120' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:21:50.917736 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:50.967395 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Flow 'volume_create_manager' (35f7dbf7-2033-4a91-a096-fee4724b8e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:50.979538 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147fdcc-d887-4043-8dba-38496896fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.009810 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4147fdcc-d887-4043-8dba-38496896fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-193095694',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3e852822-9b4e-4863-8f23-d24ed7674d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3663b13dd84f4d87954147b0fea50778',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:51Z,use_quota=True,user_id='0388449c508e47c4a90a6131b8dc0997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.017205 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfc6f5-1965-4fad-ab0a-891afda244f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.021874 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcfc6f5-1965-4fad-ab0a-891afda244f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.028094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8819a2b4-c5d4-4586-8d33-303e9dadaa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.032477 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8819a2b4-c5d4-4586-8d33-303e9dadaa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e852822-9b4e-4863-8f23-d24ed7674d0b', 'volume_name': 'volume-3e852822-9b4e-4863-8f23-d24ed7674d0b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.037812 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d45ed8-f28f-4d43-8ade-786d8f2cf5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.042977 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1d45ed8-f28f-4d43-8ade-786d8f2cf5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.048272 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46522c83-dfcd-42dc-8fb2-4204e25ac3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.049667 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Volume 3e852822-9b4e-4863-8f23-d24ed7674d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e852822-9b4e-4863-8f23-d24ed7674d0b', 'volume_size': 1}
Aug 06 21:21:51.050274 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] creating volume 'volume-3e852822-9b4e-4863-8f23-d24ed7674d0b' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:51.051314 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:51.171570 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:51.173150 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:51.173757 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:51.216726 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:21:51.222013 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Marking volume 70351e39-2844-49d7-b0b4-174a1a6f5120 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:21:51.235464 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:51.235844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:51.242705 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46522c83-dfcd-42dc-8fb2-4204e25ac3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e852822-9b4e-4863-8f23-d24ed7674d0b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.247790 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e51f9-8dc5-4378-952a-1211fc04bee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.278439 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to 70351e39-2844-49d7-b0b4-174a1a6f5120. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:21:51.280862 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Creating volume glance metadata for volume 70351e39-2844-49d7-b0b4-174a1a6f5120 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:21:51.294025 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Volume volume-3e852822-9b4e-4863-8f23-d24ed7674d0b (3e852822-9b4e-4863-8f23-d24ed7674d0b): created successfully
Aug 06 21:21:51.297558 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557e51f9-8dc5-4378-952a-1211fc04bee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.319778 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Flow 'volume_create_manager' (35f7dbf7-2033-4a91-a096-fee4724b8e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:51.362915 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-526b8ba7-8277-435f-b57c-c5d5d54eaf6f tempest-VolumesTransfersTest-1242675292 None] Created volume successfully.
Aug 06 21:21:51.532454 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34af7b43-f284-4b53-b684-f81c5bb91461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70351e39-2844-49d7-b0b4-174a1a6f5120', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c3ea7f0>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.538799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1784a252-2310-4d89-8f1d-9ff1b03e139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:51.561451 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Volume volume-70351e39-2844-49d7-b0b4-174a1a6f5120 (70351e39-2844-49d7-b0b4-174a1a6f5120): created successfully
Aug 06 21:21:51.565585 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1784a252-2310-4d89-8f1d-9ff1b03e139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:51.573496 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (f7889fbb-a573-467b-aabb-e6ce6e7a2847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:51.593430 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9dc209d8-cb0d-4cf0-9135-5e1091a2841d tempest-VolumesCloneTest-1167298391 None] Created volume successfully.
Aug 06 21:21:52.480995 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Acquiring lock "cinder-3e852822-9b4e-4863-8f23-d24ed7674d0b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:52.494065 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Lock "cinder-3e852822-9b4e-4863-8f23-d24ed7674d0b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:52.593221 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:52.751305 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:21:52.752136 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Volume volume-3e852822-9b4e-4863-8f23-d24ed7674d0b is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:52.761590 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] deleting rbd volume volume-3e852822-9b4e-4863-8f23-d24ed7674d0b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:21:52.821202 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:52.983144 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (e85c1966-0fed-4cfb-a024-63fb63e6d3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:53.012433 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247a6606-0335-49fa-aa81-eb18dbdb1f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:53.070879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (247a6606-0335-49fa-aa81-eb18dbdb1f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=True,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-197816682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8810263c-7b07-46d9-978d-44b30362e14c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ec7ca33064d058e17d7f10e583d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=70351e39-2844-49d7-b0b4-174a1a6f5120,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:53Z,use_quota=True,user_id='2a93852c0d284270bac8bfc209dc8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:53.081602 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e303c408-c385-4f00-94ff-6a4e51823972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:53.093677 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e303c408-c385-4f00-94ff-6a4e51823972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:53.100778 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d55cd-e964-45a3-b781-0695a2ced656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:53.133728 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5d55cd-e964-45a3-b781-0695a2ced656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8810263c-7b07-46d9-978d-44b30362e14c', 'volume_name': 'volume-8810263c-7b07-46d9-978d-44b30362e14c', 'volume_size': 1, 'source_volid': '70351e39-2844-49d7-b0b4-174a1a6f5120', 'source_volstatus': 'available'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:53.142366 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803478f2-ee6e-4755-b050-6e9640164980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:53.148508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803478f2-ee6e-4755-b050-6e9640164980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:53.157632 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e0cb68-ee10-4d26-8460-481bde751d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:53.159193 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Volume 8810263c-7b07-46d9-978d-44b30362e14c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8810263c-7b07-46d9-978d-44b30362e14c', 'volume_size': 1, 'source_volid': '70351e39-2844-49d7-b0b4-174a1a6f5120', 'source_volstatus': 'available'}
Aug 06 21:21:53.230632 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:53.377337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] creating snapshot='volume-8810263c-7b07-46d9-978d-44b30362e14c.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:21:53.878775 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] cloning 'volume-70351e39-2844-49d7-b0b4-174a1a6f5120@volume-8810263c-7b07-46d9-978d-44b30362e14c.clone_snap' to 'volume-8810263c-7b07-46d9-978d-44b30362e14c' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:21:53.966941 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Created reservations ['25b60f62-e8e2-453c-9dab-fa6d987156fb', '12ef10de-2ea6-421e-9ed4-9bbf0f4430ce', 'f63db913-5e3c-45a9-bf9e-bf15651be81e', '571f1fbd-ef8b-48bd-8948-e5e40c0539a2'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:21:54.051607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:54.136849 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:54.232962 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:21:54.240648 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Deleted volume successfully.
Aug 06 21:21:54.417160 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:54.434126 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:54.438918 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:54.481174 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:21:54.482106 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Marking volume 8810263c-7b07-46d9-978d-44b30362e14c as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:21:54.499257 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Copying metadata from source volume 70351e39-2844-49d7-b0b4-174a1a6f5120 to 8810263c-7b07-46d9-978d-44b30362e14c. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:439}}
Aug 06 21:21:54.505806 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-fe3ff118-a686-4c1a-86cb-851b89ee9aee tempest-VolumesTransfersTest-115173758 None] Lock "cinder-3e852822-9b4e-4863-8f23-d24ed7674d0b-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:54.595297 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e0cb68-ee10-4d26-8460-481bde751d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8810263c-7b07-46d9-978d-44b30362e14c', 'volume_size': 1, 'source_volid': '70351e39-2844-49d7-b0b4-174a1a6f5120', 'source_volstatus': 'available'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:54.603576 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a188bbb1-f15b-4e52-864b-bfe9ff91d207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:54.624136 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Volume volume-8810263c-7b07-46d9-978d-44b30362e14c (8810263c-7b07-46d9-978d-44b30362e14c): created successfully
Aug 06 21:21:54.629937 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a188bbb1-f15b-4e52-864b-bfe9ff91d207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:54.639732 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (e85c1966-0fed-4cfb-a024-63fb63e6d3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:54.670602 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-fc3e886e-05ad-4336-a576-c41f99785c97 tempest-VolumesCloneTest-1167298391 None] Created volume successfully.
Aug 06 21:21:55.141933 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:55.205633 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Flow 'volume_create_manager' (132c3b27-b90b-416d-8b5a-63266661d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:55.234379 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040ace43-46c4-4ecc-b212-4d477c13dd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:55.304246 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (040ace43-46c4-4ecc-b212-4d477c13dd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1653272169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ee08c70f33492ea61b491137cd2ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:55Z,use_quota=True,user_id='78c647f257a546b8be6bf4983b464af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:55.320132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2f24e-31f4-4942-8caa-a8619daa7b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:55.328367 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5df2f24e-31f4-4942-8caa-a8619daa7b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:55.342030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619d061-c300-42ee-a31a-5636f567de9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:55.536303 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0619d061-c300-42ee-a31a-5636f567de9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309', 'volume_name': 'volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c382850>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:55.554663 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326abc73-6a1e-4864-b2be-ebca86f25f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:55.567176 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326abc73-6a1e-4864-b2be-ebca86f25f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:55.591172 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d0ba19-2b8b-4d81-92bb-ffe1e3fdb8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:55.592489 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Volume be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c382850>}
Aug 06 21:21:55.593057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Cloning be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:21:55.599283 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:21:55.635788 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.035s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:21:55.674694 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 55, 649183)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:55.675813 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:55.677937 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:21:55.692939 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.059s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:21:55.693814 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:21:55.711865 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 21, 55, 698953)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:21:55.712301 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:21:55.712690 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:21:55.747501 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:55.875721 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] creating snapshot='volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:21:56.055908 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309.clone_snap' to 'volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:21:56.259403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Volume volume-f7a7d268-fe92-4462-a9fe-5327fe7ad7f5.deleted is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:21:56.261981 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:56.262535 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:56.280565 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:21:56.281251 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.volume_utils [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Marking volume be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309 as bootable. {{(pid=135688) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}}
Aug 06 21:21:56.294961 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Copying metadata from image 5135514a-af3f-4057-893c-38dd4d85e4cd to be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309. {{(pid=135688) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:451}}
Aug 06 21:21:56.296030 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Creating volume glance metadata for volume be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309 backed by image 5135514a-af3f-4057-893c-38dd4d85e4cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=135688) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:681}}
Aug 06 21:21:56.392206 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=22,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=22 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:56.455777 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40d0ba19-2b8b-4d81-92bb-ffe1e3fdb8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475c382850>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:56.470247 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb7cca0-0927-49fa-9bf2-064f40103760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:56.487721 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Volume volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309 (be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309): created successfully
Aug 06 21:21:56.496901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb7cca0-0927-49fa-9bf2-064f40103760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:56.505779 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Flow 'volume_create_manager' (132c3b27-b90b-416d-8b5a-63266661d00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:56.531914 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-2a0f5820-4cae-422a-a837-047421b85532 tempest-VolumesExtendTest-2022304620 None] Created volume successfully.
Aug 06 21:21:56.767362 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:56.834583 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (00dd70ea-674c-44a7-96fd-160fb4ef91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:56.863337 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6c3786-d213-476f-8101-cff1d6aee1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:56.912091 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb6c3786-d213-476f-8101-cff1d6aee1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-666306268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=79420f6f-fc4f-4cd8-bc95-353c117b0383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ec7ca33064d058e17d7f10e583d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:57Z,use_quota=True,user_id='2a93852c0d284270bac8bfc209dc8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:56.920118 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac171c6-cfc4-40d7-a287-23be1a2068da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:56.939815 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac171c6-cfc4-40d7-a287-23be1a2068da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:56.948958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208eeea-912e-49c6-b3d2-44c99dac7764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:56.953056 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f208eeea-912e-49c6-b3d2-44c99dac7764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79420f6f-fc4f-4cd8-bc95-353c117b0383', 'volume_name': 'volume-79420f6f-fc4f-4cd8-bc95-353c117b0383', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:56.966487 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef012d97-1357-4d4c-b318-166e897019ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:56.981114 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef012d97-1357-4d4c-b318-166e897019ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:57.000123 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba3420c-6866-45c8-83ad-2935f1e06230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:57.007838 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Volume 79420f6f-fc4f-4cd8-bc95-353c117b0383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79420f6f-fc4f-4cd8-bc95-353c117b0383', 'volume_size': 1}
Aug 06 21:21:57.008340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] creating volume 'volume-79420f6f-fc4f-4cd8-bc95-353c117b0383' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:21:57.010499 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:57.168599 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:21:57.168986 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:21:57.173247 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba3420c-6866-45c8-83ad-2935f1e06230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79420f6f-fc4f-4cd8-bc95-353c117b0383', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:57.183047 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4063ad2a-fdae-4c5a-9217-6de87eedf038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:57.215966 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Volume volume-79420f6f-fc4f-4cd8-bc95-353c117b0383 (79420f6f-fc4f-4cd8-bc95-353c117b0383): created successfully
Aug 06 21:21:57.220466 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4063ad2a-fdae-4c5a-9217-6de87eedf038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:57.238790 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (00dd70ea-674c-44a7-96fd-160fb4ef91d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:57.269466 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1c5c2cdd-9284-4a5c-922e-d464b753670a tempest-VolumesCloneTest-1167298391 None] Created volume successfully.
Aug 06 21:21:57.767288 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-727b2ede-26a2-49ae-ae60-9c0362ec0143 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:58.001148 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-727b2ede-26a2-49ae-ae60-9c0362ec0143 tempest-VolumesExtendTest-2022304620 None] Extend volume from 1 GB to 2 GB. {{(pid=135688) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Aug 06 21:21:58.057333 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-727b2ede-26a2-49ae-ae60-9c0362ec0143 tempest-VolumesExtendTest-2022304620 None] Extend volume completed successfully.
Aug 06 21:21:58.747555 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:DELETE=2,cinder:UPDATE=22 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:21:58.786821 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:21:58.856430 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (66b80948-c309-421d-b6ab-892e85870432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:21:58.873646 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8791aa64-fa09-46cf-9e20-0def26bd13fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:58.945488 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8791aa64-fa09-46cf-9e20-0def26bd13fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-726967237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=85c5212e-91c4-4ca3-9447-bc59b6c5f33f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae2ec7ca33064d058e17d7f10e583d42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:21:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=79420f6f-fc4f-4cd8-bc95-353c117b0383,status='creating',terminated_at=None,updated_at=2022-08-06T21:21:59Z,use_quota=True,user_id='2a93852c0d284270bac8bfc209dc8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:58.961068 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b156034-e231-4c0e-bb1c-1d2d949d7d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:58.973224 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b156034-e231-4c0e-bb1c-1d2d949d7d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:58.986063 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0649191-73a2-4bf8-b41e-fdf4c86421f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:59.029515 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0649191-73a2-4bf8-b41e-fdf4c86421f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85c5212e-91c4-4ca3-9447-bc59b6c5f33f', 'volume_name': 'volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f', 'volume_size': 2, 'source_volid': '79420f6f-fc4f-4cd8-bc95-353c117b0383', 'source_volstatus': 'available'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:59.050040 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f4f575-6ce0-45b1-aafd-e1f29bdcb4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:59.062909 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f4f575-6ce0-45b1-aafd-e1f29bdcb4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:21:59.093016 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e8542c-5984-45ce-8627-7f72bd26f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:21:59.095759 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Volume 85c5212e-91c4-4ca3-9447-bc59b6c5f33f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f', 'volume_size': 2, 'source_volid': '79420f6f-fc4f-4cd8-bc95-353c117b0383', 'source_volstatus': 'available'}
Aug 06 21:21:59.127982 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:21:59.242887 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] creating snapshot='volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:22:00.106291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] cloning 'volume-79420f6f-fc4f-4cd8-bc95-353c117b0383@volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f.clone_snap' to 'volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:22:00.159879 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:00.240355 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Flow 'volume_create_manager' (5cb5c4b6-e27c-49e7-96f2-732b4d79b068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:00.254107 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e001cf24-00a7-4bcb-9404-7c64b270a62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.305439 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Volume volume-79420f6f-fc4f-4cd8-bc95-353c117b0383 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:00.307513 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:00.310577 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:00.396794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] resize volume 'volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f' from 1 to 2 {{(pid=135688) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:745}}
Aug 06 21:22:00.397432 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:00.508350 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e001cf24-00a7-4bcb-9404-7c64b270a62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-242833250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=680bd879-5253-4d7b-930f-0cbd99610a6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ee08c70f33492ea61b491137cd2ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:00Z,use_quota=True,user_id='78c647f257a546b8be6bf4983b464af1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.521119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae26916-803a-47b6-9036-164d3e3e6a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.531692 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae26916-803a-47b6-9036-164d3e3e6a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.552733 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f99db-bfce-4fb9-b83d-d4441f11bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.557479 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2f99db-bfce-4fb9-b83d-d4441f11bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680bd879-5253-4d7b-930f-0cbd99610a6a', 'volume_name': 'volume-680bd879-5253-4d7b-930f-0cbd99610a6a', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.562415 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f803224-6afd-44ed-848c-79c2fa62ef7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.566405 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f803224-6afd-44ed-848c-79c2fa62ef7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.573814 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9259657e-00b7-443c-9b66-4969a3d58bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.575342 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Volume 680bd879-5253-4d7b-930f-0cbd99610a6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680bd879-5253-4d7b-930f-0cbd99610a6a', 'volume_size': 1}
Aug 06 21:22:00.576256 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] creating volume 'volume-680bd879-5253-4d7b-930f-0cbd99610a6a' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:00.577206 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:00.687245 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] clone created successfully {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:858}}
Aug 06 21:22:00.691903 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e8542c-5984-45ce-8627-7f72bd26f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f', 'volume_size': 2, 'source_volid': '79420f6f-fc4f-4cd8-bc95-353c117b0383', 'source_volstatus': 'available'}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.708196 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ac2dd-c700-47a8-9cd3-1aa714d14ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.748985 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:00.749581 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:00.754627 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9259657e-00b7-443c-9b66-4969a3d58bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680bd879-5253-4d7b-930f-0cbd99610a6a', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.783445 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdab188-1eff-49f0-b864-014a08f69aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:00.795722 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Volume volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f (85c5212e-91c4-4ca3-9447-bc59b6c5f33f): created successfully
Aug 06 21:22:00.828044 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c5ac2dd-c700-47a8-9cd3-1aa714d14ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.841675 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Flow 'volume_create_manager' (66b80948-c309-421d-b6ab-892e85870432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:00.844652 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Volume volume-680bd879-5253-4d7b-930f-0cbd99610a6a (680bd879-5253-4d7b-930f-0cbd99610a6a): created successfully
Aug 06 21:22:00.849665 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcdab188-1eff-49f0-b864-014a08f69aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:00.856867 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Flow 'volume_create_manager' (5cb5c4b6-e27c-49e7-96f2-732b4d79b068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:00.872443 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-164f1e3d-ebce-4efd-8fb8-484d791a0741 tempest-VolumesExtendTest-2022304620 None] Created volume successfully.
Aug 06 21:22:00.880102 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7f92987e-ab52-425e-a1a4-3ee5bcde6094 tempest-VolumesCloneTest-1167298391 None] Created volume successfully.
Aug 06 21:22:02.063427 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Acquiring lock "cinder-85c5212e-91c4-4ca3-9447-bc59b6c5f33f-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:02.088905 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Lock "cinder-85c5212e-91c4-4ca3-9447-bc59b6c5f33f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:02.186595 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:02.286937 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:02.294782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] deleting rbd volume volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:02.511070 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-63ae0be3-7501-43cb-9bf2-799bc1ec7e30 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:02.637220 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:22:02.672688 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Volume volume-79420f6f-fc4f-4cd8-bc95-353c117b0383 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:02.673378 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] deleting parent snapshot volume-85c5212e-91c4-4ca3-9447-bc59b6c5f33f.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:22:03.371677 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Created reservations ['b9491947-85e8-4bd0-8db2-1293d3de16cd', '2bda0eca-b7c4-4e81-a34d-1164d651616d', 'e11d443b-c56f-455e-9210-4ceb2aef5917', 'ed18c21d-0891-48c9-8f70-fada91821b41'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:03.420022 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-63ae0be3-7501-43cb-9bf2-799bc1ec7e30 tempest-VolumesExtendTest-2022304620 None] Create snapshot completed successfully
Aug 06 21:22:03.498152 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:03.639701 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:03.779253 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:03.783829 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Deleted volume successfully.
Aug 06 21:22:03.805782 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-a2ffbfd1-0b4d-4d2b-9098-2349a4498178 tempest-VolumesCloneTest-1167298391 None] Lock "cinder-85c5212e-91c4-4ca3-9447-bc59b6c5f33f-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:03.855021 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-70ed7d18-fad2-4429-9a50-668b2cb4abd3 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:04.031805 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-70ed7d18-fad2-4429-9a50-668b2cb4abd3 tempest-VolumesExtendTest-2022304620 None] Extend volume from 1 GB to 2 GB. {{(pid=135688) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1878}}
Aug 06 21:22:04.083906 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-70ed7d18-fad2-4429-9a50-668b2cb4abd3 tempest-VolumesExtendTest-2022304620 None] Extend volume completed successfully.
Aug 06 21:22:04.549316 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Acquiring lock "cinder-79420f6f-fc4f-4cd8-bc95-353c117b0383-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:04.608149 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Lock "cinder-79420f6f-fc4f-4cd8-bc95-353c117b0383-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:04.822299 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:04.927457 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:04.928261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Volume volume-79420f6f-fc4f-4cd8-bc95-353c117b0383 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:04.937503 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] deleting rbd volume volume-79420f6f-fc4f-4cd8-bc95-353c117b0383 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:05.327275 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] Acquiring lock "cinder-e0b3c4cf-9cca-462b-b4b6-8b506686938a-delete_snapshot" by "delete_snapshot" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:05.341355 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-e0b3c4cf-9cca-462b-b4b6-8b506686938a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:05.345969 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:05.573559 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Created reservations ['6b89a327-1ebe-45a1-9dae-2b939de49e4d', 'cdba14d5-cc04-4a28-b703-94c94926fc35', 'c1890fbe-a0e0-49da-9dcb-c8bc5d2d3308', '67c48beb-decd-44d2-bc35-9d74ff5d050b'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:05.703840 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:05.805997 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:05.876418 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:05.880775 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Deleted volume successfully.
Aug 06 21:22:05.911473 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7d0147df-ed5a-4a87-9261-53151c24ceec tempest-VolumesCloneTest-1167298391 None] Lock "cinder-79420f6f-fc4f-4cd8-bc95-353c117b0383-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:06.060198 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Acquiring lock "cinder-8810263c-7b07-46d9-978d-44b30362e14c-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:06.075639 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Lock "cinder-8810263c-7b07-46d9-978d-44b30362e14c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:06.154301 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=59,cinder:UPDATE=32,cinder:DELETE=4,cinder:INSERT=5 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:06.158850 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:06.348705 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:06.359446 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] deleting rbd volume volume-8810263c-7b07-46d9-978d-44b30362e14c {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:06.408975 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:06.473116 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Flow 'volume_create_manager' (ea4af6de-1d60-4580-8d16-5475b31e3764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:06.488792 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97208a1-b7db-4032-b3ef-47dc555382da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.538713 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97208a1-b7db-4032-b3ef-47dc555382da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-453069618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=4565e454-f752-4ac8-ae6d-7d6828127771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12f4b2bbfc3438fae396fedd6552a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:06Z,use_quota=True,user_id='9c1b8e18f09047d598483fa8b5afcc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:06.547547 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79984da9-e552-457c-a7f4-8d0ce2fb5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.554844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79984da9-e552-457c-a7f4-8d0ce2fb5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:06.564952 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60fd61a-65ec-4283-aa39-9638f89349d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.574325 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60fd61a-65ec-4283-aa39-9638f89349d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4565e454-f752-4ac8-ae6d-7d6828127771', 'volume_name': 'volume-4565e454-f752-4ac8-ae6d-7d6828127771', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:06.581029 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a5c824-7a7f-4f88-89e6-60ec23cb3df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.597074 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31a5c824-7a7f-4f88-89e6-60ec23cb3df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:06.616477 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e6bb78-3861-4bfa-8fc0-4ee0014d09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.618613 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Volume 4565e454-f752-4ac8-ae6d-7d6828127771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4565e454-f752-4ac8-ae6d-7d6828127771', 'volume_size': 1}
Aug 06 21:22:06.619854 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] creating volume 'volume-4565e454-f752-4ac8-ae6d-7d6828127771' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:06.621542 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:06.760818 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:06.761589 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:06.766810 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e6bb78-3861-4bfa-8fc0-4ee0014d09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4565e454-f752-4ac8-ae6d-7d6828127771', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:06.771779 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66cbc18-9b6d-4507-9cd7-792d0cb29f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:06.780554 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:22:06.849637 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] deleting parent snapshot volume-8810263c-7b07-46d9-978d-44b30362e14c.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:22:07.328461 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] Created reservations ['4fa034f3-f9fd-44ee-9444-ba6b8ba3e340', '3b8d84c6-2a8e-4e12-93fe-735d71fc472b', '046ed4f7-b453-408d-aa29-f994bec2d70d', '7dd690d2-abd2-4281-953c-11ece1ccf940'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:07.339186 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Volume volume-4565e454-f752-4ac8-ae6d-7d6828127771 (4565e454-f752-4ac8-ae6d-7d6828127771): created successfully
Aug 06 21:22:07.342819 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f66cbc18-9b6d-4507-9cd7-792d0cb29f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:07.367765 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Flow 'volume_create_manager' (ea4af6de-1d60-4580-8d16-5475b31e3764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:07.394893 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1613d9b6-ee91-4f69-8bbb-8698612a9628 tempest-VolumesTransfersV355Test-165241179 None] Created volume successfully.
Aug 06 21:22:07.437661 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Created reservations ['fcddc5f0-9350-4c9d-8120-d60949151f80', '7d704a85-74bd-4f78-9a3b-755ca10eab86', 'cd5ebd24-d15a-493c-872f-64ea65e8e21b', 'b74318db-d004-4d48-8f72-a4c167fad640'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:07.469634 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=7 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:07.489820 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] Delete snapshot completed successfully.
Aug 06 21:22:07.512811 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-233ebf44-63a2-433c-b478-c1306a478c70 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-e0b3c4cf-9cca-462b-b4b6-8b506686938a-delete_snapshot" released by "delete_snapshot" :: held 2.173s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:07.571544 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:07.670607 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:07.762736 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:07.768023 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Acquiring lock "cinder-680bd879-5253-4d7b-930f-0cbd99610a6a-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:07.792328 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Deleted volume successfully.
Aug 06 21:22:07.831810 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-680bd879-5253-4d7b-930f-0cbd99610a6a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:07.856643 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-365e004d-03e8-4f11-8015-4f43842f8f14 tempest-VolumesCloneTest-1167298391 None] Lock "cinder-8810263c-7b07-46d9-978d-44b30362e14c-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:07.913460 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:08.012169 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:08.012592 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Volume volume-680bd879-5253-4d7b-930f-0cbd99610a6a is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:08.020026 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] deleting rbd volume volume-680bd879-5253-4d7b-930f-0cbd99610a6a {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:08.457761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Created reservations ['18248252-e433-40ab-a042-fa466b4bbfd1', 'c306bd2a-af61-49ce-809f-bdcfccb75ca3', '0c261e38-9200-4d56-a7e5-2a2c85acf248', 'debf2519-fe21-4026-a759-7927177aea51'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:08.555695 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Acquiring lock "cinder-70351e39-2844-49d7-b0b4-174a1a6f5120-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:08.630895 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Lock "cinder-70351e39-2844-49d7-b0b4-174a1a6f5120-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:08.683459 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:08.730568 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:08.824420 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:08.832010 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Deleted volume successfully.
Aug 06 21:22:08.922136 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:09.060564 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:09.075195 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] deleting rbd volume volume-70351e39-2844-49d7-b0b4-174a1a6f5120 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:09.077315 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-9182970e-c530-4380-9427-001912449a64 tempest-VolumesExtendTest-2022304620 None] Lock "cinder-680bd879-5253-4d7b-930f-0cbd99610a6a-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:09.083657 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Acquiring lock "cinder-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:09.107658 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Lock "cinder-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:09.214904 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:09.399533 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:09.414007 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] deleting rbd volume volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:09.496459 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:22:09.552756 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] deleting parent snapshot volume-70351e39-2844-49d7-b0b4-174a1a6f5120.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:22:10.409376 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] volume is a clone so cleaning references {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:22:10.462948 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] deleting parent snapshot volume-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309.clone_snap {{(pid=135688) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:22:11.484452 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-8a2402d9-6777-47ea-a9f1-190e0426c483 tempest-VolumesTransfersV355Test-1178222555 None] Transfer volume completed successfully.
Aug 06 21:22:11.495276 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Created reservations ['3c503ad4-6fa7-45f1-ae1c-9fa302e13bba', '06f23700-a801-42af-a638-7b9d6516f6aa', '353aec73-c2bb-4301-a42d-92afc8c6a919', 'b1ee05a8-0126-4761-b692-6ba284f22df7'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:11.607965 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Created reservations ['9d987e88-da05-4d5a-88a3-d045f597d5e8', '1fa134a6-5bfb-44f2-bfff-5d0a54758514', '0c5d3f33-2cf6-4f04-b85e-62af616f25d6', '6fa4762e-b38f-431b-8b8f-f2d83edcf388'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:11.717468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:11.835671 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:11.927059 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:11.934122 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:12.046040 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:12.146055 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:12.151264 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Deleted volume successfully.
Aug 06 21:22:12.179781 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b08df3fb-ecd1-413a-b8da-416b801e07af tempest-VolumesCloneTest-1167298391 None] Lock "cinder-70351e39-2844-49d7-b0b4-174a1a6f5120-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:12.192502 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Deleted volume successfully.
Aug 06 21:22:12.222144 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-c1faa1e6-1966-425c-af6e-b46134aef86d tempest-VolumesExtendTest-2022304620 None] Lock "cinder-be01ed1d-9fc0-4bbc-9ba6-d73bb39b6309-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:12.365947 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Acquiring lock "cinder-4565e454-f752-4ac8-ae6d-7d6828127771-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:12.389581 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Lock "cinder-4565e454-f752-4ac8-ae6d-7d6828127771-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:12.454172 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=57,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:12.480058 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:12.600054 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:12.600679 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Volume volume-4565e454-f752-4ac8-ae6d-7d6828127771 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:12.617519 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] deleting rbd volume volume-4565e454-f752-4ac8-ae6d-7d6828127771 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:13.086794 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Created reservations ['fdaa161b-0d3e-4037-adbd-d85d500194b0', 'bfffeb03-2865-4145-bfd0-5baae341399d', '65dc93a6-9dd1-4729-806e-5a3c9df86efd', '3c0a7b0e-377e-41d6-baff-3d9256b0b3e9'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:13.130433 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=34,cinder:DELETE=3,cinder:SELECT=51,cinder:INSERT=12 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:13.203963 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:13.291297 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:13.412226 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:13.419346 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Deleted volume successfully.
Aug 06 21:22:13.444061 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-7eb892e9-3bda-4360-a0e1-189ce21d0fc1 tempest-VolumesTransfersV355Test-754736912 None] Lock "cinder-4565e454-f752-4ac8-ae6d-7d6828127771-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:14.295433 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:14.365591 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Flow 'volume_create_manager' (7ddf890f-4cdc-4aac-8c2c-156ee54c2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:14.381136 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c780a30-8e8e-4803-bbc1-bac9f2be8b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.414594 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c780a30-8e8e-4803-bbc1-bac9f2be8b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-675752586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=99869a1a-3dae-4671-8567-7f0687bffbc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d12f4b2bbfc3438fae396fedd6552a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:14Z,use_quota=True,user_id='9c1b8e18f09047d598483fa8b5afcc9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.447137 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02231691-4740-4e05-a1fb-1c52a4c715d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.451931 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02231691-4740-4e05-a1fb-1c52a4c715d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.464672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600a73a4-e071-42ff-a14c-fefddade3e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.469109 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600a73a4-e071-42ff-a14c-fefddade3e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99869a1a-3dae-4671-8567-7f0687bffbc8', 'volume_name': 'volume-99869a1a-3dae-4671-8567-7f0687bffbc8', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.485112 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c0d179-b861-4704-9c98-a9da51d57431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.497407 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c0d179-b861-4704-9c98-a9da51d57431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.507178 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403437c5-eeb4-48f8-9f47-fb83d946fae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.507178 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Volume 99869a1a-3dae-4671-8567-7f0687bffbc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99869a1a-3dae-4671-8567-7f0687bffbc8', 'volume_size': 1}
Aug 06 21:22:14.507178 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] creating volume 'volume-99869a1a-3dae-4671-8567-7f0687bffbc8' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:14.509674 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:14.682024 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:14.682382 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:14.690600 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403437c5-eeb4-48f8-9f47-fb83d946fae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99869a1a-3dae-4671-8567-7f0687bffbc8', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.695207 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafeaa09-eadd-4303-8844-ca0eb8fd9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:14.735627 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Volume volume-99869a1a-3dae-4671-8567-7f0687bffbc8 (99869a1a-3dae-4671-8567-7f0687bffbc8): created successfully
Aug 06 21:22:14.739769 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dafeaa09-eadd-4303-8844-ca0eb8fd9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:14.754965 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Flow 'volume_create_manager' (7ddf890f-4cdc-4aac-8c2c-156ee54c2df7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:14.802121 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-53fbef42-55af-4c5f-90ce-c9864765df7d tempest-VolumesTransfersV355Test-165241179 None] Created volume successfully.
Aug 06 21:22:15.969940 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Acquiring lock "cinder-99869a1a-3dae-4671-8567-7f0687bffbc8-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:15.995024 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Lock "cinder-99869a1a-3dae-4671-8567-7f0687bffbc8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:16.076242 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:16.198316 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:16.198770 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Volume volume-99869a1a-3dae-4671-8567-7f0687bffbc8 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:16.211486 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] deleting rbd volume volume-99869a1a-3dae-4671-8567-7f0687bffbc8 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:16.761286 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Created reservations ['ecfd724f-4de2-408b-be86-98b0639243c5', '09032aa4-673d-4ce3-adaf-285fb4504ca1', '0d3c3040-8e7d-464b-885f-031da239337d', '1849cac4-54ed-48a8-8bdf-c118199f81be'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:16.871247 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:16.952901 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:17.026279 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:17.031461 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Deleted volume successfully.
Aug 06 21:22:17.056946 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-02e09b7c-2556-4d69-9229-f0a6de290015 tempest-VolumesTransfersV355Test-754736912 None] Lock "cinder-99869a1a-3dae-4671-8567-7f0687bffbc8-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:17.642845 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:17.693705 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Flow 'volume_create_manager' (7f745938-5034-4fce-b73a-f0b5b707c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:17.704830 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2f2c6f-52c0-4581-afb0-7a34f03d6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:17.786212 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2f2c6f-52c0-4581-afb0-7a34f03d6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-371538321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=3f65646e-226d-4928-80dc-31875d4c3bff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a551e0a60084282aa0c986d737e30ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:18Z,use_quota=True,user_id='d2580e8e5886464baa08bad44e397976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:17.804119 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d138288-d8e7-4e11-851c-0aed216955bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:17.837399 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d138288-d8e7-4e11-851c-0aed216955bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:17.855844 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c579b0f-44bf-4b48-b149-1fe6bfab0a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:17.860217 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c579b0f-44bf-4b48-b149-1fe6bfab0a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f65646e-226d-4928-80dc-31875d4c3bff', 'volume_name': 'volume-3f65646e-226d-4928-80dc-31875d4c3bff', 'volume_size': 2}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:17.879709 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7c8f85-4119-48f7-8c4c-7f84bce2e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:17.883926 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa7c8f85-4119-48f7-8c4c-7f84bce2e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:17.897506 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc3d46a-253f-4b50-beec-21ffbb0c7bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:17.901623 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Volume 3f65646e-226d-4928-80dc-31875d4c3bff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f65646e-226d-4928-80dc-31875d4c3bff', 'volume_size': 2}
Aug 06 21:22:17.905207 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] creating volume 'volume-3f65646e-226d-4928-80dc-31875d4c3bff' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:17.906122 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:18.079057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:18.079628 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:18.083491 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bc3d46a-253f-4b50-beec-21ffbb0c7bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f65646e-226d-4928-80dc-31875d4c3bff', 'volume_size': 2}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.093340 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ebc18-5b89-4766-92bb-ef746924dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.115011 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Volume volume-3f65646e-226d-4928-80dc-31875d4c3bff (3f65646e-226d-4928-80dc-31875d4c3bff): created successfully
Aug 06 21:22:18.120094 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (484ebc18-5b89-4766-92bb-ef746924dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.132440 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Flow 'volume_create_manager' (7f745938-5034-4fce-b73a-f0b5b707c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:18.154808 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-5b80265c-34b3-42be-ae2e-1d6e90939ab0 tempest-VolumesCloneNegativeTest-1576399141 None] Created volume successfully.
Aug 06 21:22:18.308388 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:18.345663 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (9aae7679-9f53-4ba8-8d98-0eb1a99dbd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:18.353922 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca21cf5f-d830-45cc-a541-96ed550f5734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.374592 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca21cf5f-d830-45cc-a541-96ed550f5734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1619684811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=8264ce9e-dc25-4957-a6a7-26b3b0e5c84b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48b22626c5b54f7fa02570b7184d3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:18Z,use_quota=True,user_id='576508c656f6423aa41c57876e740c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.380667 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11c31b0-1b1b-4f39-bbd3-62d332136ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.385116 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d11c31b0-1b1b-4f39-bbd3-62d332136ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.390643 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e4f8dc-580d-417f-93a2-1cee9013b9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.394904 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10e4f8dc-580d-417f-93a2-1cee9013b9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8264ce9e-dc25-4957-a6a7-26b3b0e5c84b', 'volume_name': 'volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.401149 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc51d3-f7d4-4a25-a196-200903defd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.406956 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bedc51d3-f7d4-4a25-a196-200903defd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.412737 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9708cbd-558b-40f6-98d3-72d1388a4d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.414217 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Volume 8264ce9e-dc25-4957-a6a7-26b3b0e5c84b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b', 'volume_size': 1}
Aug 06 21:22:18.414867 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] creating volume 'volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:18.416544 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:18.521163 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:18.521723 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:18.526056 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9708cbd-558b-40f6-98d3-72d1388a4d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.530508 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485af041-44ba-4322-9e38-213384f5d486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:18.540826 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Volume volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b (8264ce9e-dc25-4957-a6a7-26b3b0e5c84b): created successfully
Aug 06 21:22:18.545229 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485af041-44ba-4322-9e38-213384f5d486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:18.551057 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (9aae7679-9f53-4ba8-8d98-0eb1a99dbd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:18.566448 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-f84c6805-e28d-4dd8-acfe-96e2bcd85751 tempest-VolumesListTestJSON-1735007052 None] Created volume successfully.
Aug 06 21:22:18.694631 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Acquiring lock "cinder-3f65646e-226d-4928-80dc-31875d4c3bff-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:18.708841 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Lock "cinder-3f65646e-226d-4928-80dc-31875d4c3bff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:18.783842 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:18.852068 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:18.853040 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Volume volume-3f65646e-226d-4928-80dc-31875d4c3bff is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:18.859369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] deleting rbd volume volume-3f65646e-226d-4928-80dc-31875d4c3bff {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:19.084740 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Created reservations ['66a359d4-7b50-4d95-b509-b6c03ee44684', 'a5cc2b14-ff04-45d6-97c7-5651a171d83f', '2c8f9548-d9c2-4fa8-9376-ac9fcee2a157', 'b4648560-eec2-4df6-a3f8-06db74154ede'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:19.145286 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:19.214426 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:19.341387 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:19.351999 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Deleted volume successfully.
Aug 06 21:22:19.388120 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-e17e948c-416f-42f4-993f-f01e467639a4 tempest-VolumesCloneNegativeTest-1576399141 None] Lock "cinder-3f65646e-226d-4928-80dc-31875d4c3bff-delete_volume" released by "delete_volume" :: held 0.679s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:20.016419 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:20.051069 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (0abd26c8-e11a-4930-ae11-c780e84f107d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:20.058496 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbecf71-a88c-4c52-82e0-648e08ad8abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.088514 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbecf71-a88c-4c52-82e0-648e08ad8abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-220406556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=897e703d-6e54-43eb-93ac-7881a89c1e06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48b22626c5b54f7fa02570b7184d3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:20Z,use_quota=True,user_id='576508c656f6423aa41c57876e740c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.101232 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fadb0a2-149a-42f3-82ad-ab3e5b6c7da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.105447 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fadb0a2-149a-42f3-82ad-ab3e5b6c7da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.120982 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5189ef7a-3db1-4973-8c69-6227b30c0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.125091 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5189ef7a-3db1-4973-8c69-6227b30c0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897e703d-6e54-43eb-93ac-7881a89c1e06', 'volume_name': 'volume-897e703d-6e54-43eb-93ac-7881a89c1e06', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.129988 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39c5fdd-4b42-4f86-95f4-6cc3f1b305e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.134635 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39c5fdd-4b42-4f86-95f4-6cc3f1b305e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.139523 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925efa0d-36ab-47c3-91b5-fb3497c64443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.140802 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Volume 897e703d-6e54-43eb-93ac-7881a89c1e06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897e703d-6e54-43eb-93ac-7881a89c1e06', 'volume_size': 1}
Aug 06 21:22:20.141502 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] creating volume 'volume-897e703d-6e54-43eb-93ac-7881a89c1e06' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:20.142424 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:20.213933 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:20.215316 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:20.220924 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925efa0d-36ab-47c3-91b5-fb3497c64443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897e703d-6e54-43eb-93ac-7881a89c1e06', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.226764 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76c6438-19ce-407c-9ab6-35a40be4ec56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:20.251641 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Volume volume-897e703d-6e54-43eb-93ac-7881a89c1e06 (897e703d-6e54-43eb-93ac-7881a89c1e06): created successfully
Aug 06 21:22:20.258222 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d76c6438-19ce-407c-9ab6-35a40be4ec56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:20.272234 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (0abd26c8-e11a-4930-ae11-c780e84f107d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:20.284162 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-64b27964-b84c-48bc-96a9-781089e47dc7 tempest-VolumesListTestJSON-1735007052 None] Created volume successfully.
Aug 06 21:22:20.300429 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=52,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=4 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:20.718890 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_service.periodic_task [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=135688) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:22:20.719743 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:20.782434 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:20.851800 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-afd10937-4eef-434e-92b7-4ba661aff633 None None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:21.589868 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:21.620097 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (9ae9e9ec-f09a-49e6-b347-a0d48908c681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:21.650452 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a073f8-f72e-41de-9086-a61bb074a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.692367 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a073f8-f72e-41de-9086-a61bb074a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1348088686',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=15398059-146e-45ec-aa06-7fe82208f568,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='48b22626c5b54f7fa02570b7184d3d9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:22Z,use_quota=True,user_id='576508c656f6423aa41c57876e740c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.708455 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1929d358-d6c9-49c6-9427-90ac01569bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.717238 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1929d358-d6c9-49c6-9427-90ac01569bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.726702 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8108d770-367b-48a3-9167-d42d00b814e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.731817 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8108d770-367b-48a3-9167-d42d00b814e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15398059-146e-45ec-aa06-7fe82208f568', 'volume_name': 'volume-15398059-146e-45ec-aa06-7fe82208f568', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.737686 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1841e10f-5023-4cc7-867c-6cdc1e2397ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.743634 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1841e10f-5023-4cc7-867c-6cdc1e2397ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.750736 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a39de0-479e-4698-99f0-6191a603b10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.752145 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Volume 15398059-146e-45ec-aa06-7fe82208f568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15398059-146e-45ec-aa06-7fe82208f568', 'volume_size': 1}
Aug 06 21:22:21.753515 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] creating volume 'volume-15398059-146e-45ec-aa06-7fe82208f568' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:21.754509 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:21.888299 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:21.888672 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:21.892355 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41a39de0-479e-4698-99f0-6191a603b10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15398059-146e-45ec-aa06-7fe82208f568', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.907589 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c0176f-9dc4-4750-b90e-6189d5509569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:21.928555 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Volume volume-15398059-146e-45ec-aa06-7fe82208f568 (15398059-146e-45ec-aa06-7fe82208f568): created successfully
Aug 06 21:22:21.932956 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2c0176f-9dc4-4750-b90e-6189d5509569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:21.948542 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Flow 'volume_create_manager' (9ae9e9ec-f09a-49e6-b347-a0d48908c681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:21.972299 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-1ed4aade-3214-4771-8356-e1dd4d83e6ab tempest-VolumesListTestJSON-1735007052 None] Created volume successfully.
Aug 06 21:22:22.178411 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-779722f2-103a-4de1-8b44-505b5e1182e9 req-3d94b71d-6435-4adb-beba-bb3539388051 tempest-AttachVolumeShelveTestJSON-1443103339 None] No connector for attachment edf05efd-ee65-4f20-b48a-57394e08a47d; skipping storage backend terminate_connection call. {{(pid=135688) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4953}}
Aug 06 21:22:22.180238 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-779722f2-103a-4de1-8b44-505b5e1182e9 req-3d94b71d-6435-4adb-beba-bb3539388051 tempest-AttachVolumeShelveTestJSON-1443103339 None] Deleting attachment edf05efd-ee65-4f20-b48a-57394e08a47d. {{(pid=135688) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:22:25.039362 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:25.089096 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (628e1d4b-c220-4e90-85c6-31c06684883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:25.118620 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dc1eba-18a0-4943-90d6-044617cfa51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.153264 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2dc1eba-18a0-4943-90d6-044617cfa51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1962692414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc7cec8b-4a90-4bae-8665-65bc2b7afa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:25Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.169744 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31fbbde-180f-4976-b9d9-51abe5ea221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.179387 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31fbbde-180f-4976-b9d9-51abe5ea221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.189613 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3f2cf6-1f6b-45b3-b4ca-6b36b5414ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.201333 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3f2cf6-1f6b-45b3-b4ca-6b36b5414ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'volume_name': 'volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.210039 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c71a7a7-b5c8-499a-b9b8-893c80b34f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.218029 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c71a7a7-b5c8-499a-b9b8-893c80b34f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.229291 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1facb26-07f0-4789-ab66-482998567004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.230405 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Volume dc7cec8b-4a90-4bae-8665-65bc2b7afa72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'volume_size': 1}
Aug 06 21:22:25.230837 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] creating volume 'volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72' {{(pid=135688) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:22:25.231497 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:25.391580 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:22:25.392012 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=135688) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:22:25.395994 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1facb26-07f0-4789-ab66-482998567004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'volume_size': 1}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.405847 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92dac2d-2bc7-4870-8783-3ca9bf570a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:25.420483 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Volume volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72 (dc7cec8b-4a90-4bae-8665-65bc2b7afa72): created successfully
Aug 06 21:22:25.428804 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92dac2d-2bc7-4870-8783-3ca9bf570a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:25.444624 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (628e1d4b-c220-4e90-85c6-31c06684883d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:25.463534 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-df9d6d41-9983-439f-a2d5-c918a381d6a1 tempest-VolumesBackupsTest-787187355 None] Created volume successfully.
Aug 06 21:22:26.407914 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Acquiring lock "cinder-15398059-146e-45ec-aa06-7fe82208f568-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:26.446997 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-15398059-146e-45ec-aa06-7fe82208f568-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:26.575481 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:26.666418 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:26.666872 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Volume volume-15398059-146e-45ec-aa06-7fe82208f568 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:26.683761 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] deleting rbd volume volume-15398059-146e-45ec-aa06-7fe82208f568 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:27.140408 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Created reservations ['369628b9-d1a8-4758-b104-0b3fcecf4836', 'ada4f2bc-8bd4-4504-aa21-e522d3f360a1', '2b461152-568c-4337-921b-8ea4a7c22696', '55c17dec-3484-4cf4-9579-09cae59be2b1'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:27.240685 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:UPDATE=31,cinder:SELECT=58,cinder:INSERT=6,cinder:DELETE=5 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:27.253958 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:27.351403 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:27.421400 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:27.435308 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Deleted volume successfully.
Aug 06 21:22:27.452585 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-326c2011-4a55-4ffd-99b9-d4db9d32b37e tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-15398059-146e-45ec-aa06-7fe82208f568-delete_volume" released by "delete_volume" :: held 1.008s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:27.759468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Acquiring lock "cinder-897e703d-6e54-43eb-93ac-7881a89c1e06-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:27.778353 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-897e703d-6e54-43eb-93ac-7881a89c1e06-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:27.878942 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:27.999799 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:28.000468 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Volume volume-897e703d-6e54-43eb-93ac-7881a89c1e06 is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:28.023323 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] deleting rbd volume volume-897e703d-6e54-43eb-93ac-7881a89c1e06 {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:28.428703 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Created reservations ['71f7185d-70d6-45b4-8072-40189706d6b8', 'a869f593-783a-4c21-b5fd-ea27df1408b3', '8fe78cf1-28d1-4208-808d-15e336b47b51', '6161e656-2892-4d48-ab5f-076f2bfcc6b2'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:28.565067 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:28.673480 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:28.741534 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:28.754438 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Deleted volume successfully.
Aug 06 21:22:28.784739 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-31d58cb2-2827-4b68-a6f0-20365e729466 tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-897e703d-6e54-43eb-93ac-7881a89c1e06-delete_volume" released by "delete_volume" :: held 1.006s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:29.136593 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Acquiring lock "cinder-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b-delete_volume" by "delete_volume" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:29.155736 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:29.277261 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:29.395967 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] volume has no backup snaps {{(pid=135688) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:22:29.397993 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Volume volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b is not a clone. {{(pid=135688) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:22:29.412144 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] deleting rbd volume volume-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b {{(pid=135688) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:22:29.814683 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.quota [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Created reservations ['03cd29e0-96d6-42d5-a329-a29aff8e39e5', '295aea7b-5ad5-43d8-bb38-b729819ca278', '67cd7224-767a-4cad-8920-a464691217f8', '9859dd64-5857-4ea9-b21c-64e9ce02e4c6'] {{(pid=135688) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:22:29.920578 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:30.031369 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:30.138704 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.manager [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Notifying Schedulers of capabilities ... {{(pid=135688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:22:30.144063 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Deleted volume successfully.
Aug 06 21:22:30.166251 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-b0cf0d18-d14b-4387-aada-1616e3ce129b tempest-VolumesListTestJSON-1735007052 None] Lock "cinder-8264ce9e-dc25-4957-a6a7-26b3b0e5c84b-delete_volume" released by "delete_volume" :: held 1.010s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:52.652084 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=29,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=1 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:52.653658 ncdv-master-1 cinder-volume[135688]: DEBUG dbcounter [-] [135688] Writing DB stats cinder:SELECT=51,cinder:UPDATE=34,cinder:INSERT=5,cinder:DELETE=2 {{(pid=135688) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:22:53.066281 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-201d4298-f271-47e0-803f-f4f16d816196 req-d63d5ce5-22fd-4abf-b229-c3f999ae3adf tempest-VolumesBackupsTest-787187355 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:22:54.667832 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [req-201d4298-f271-47e0-803f-f4f16d816196 req-d63d5ce5-22fd-4abf-b229-c3f999ae3adf tempest-VolumesBackupsTest-787187355 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.601s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:22:54.669547 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [req-201d4298-f271-47e0-803f-f4f16d816196 req-d63d5ce5-22fd-4abf-b229-c3f999ae3adf tempest-VolumesBackupsTest-787187355 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:22:54.727463 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [req-201d4298-f271-47e0-803f-f4f16d816196 req-d63d5ce5-22fd-4abf-b229-c3f999ae3adf tempest-VolumesBackupsTest-787187355 None] Connection info returned from driver {'name': 'volumes/volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '041ed59a-6ebf-4f0d-bc3b-6d3141cdfe55'} {{(pid=135688) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4867}}
Aug 06 21:22:54.838653 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [req-201d4298-f271-47e0-803f-f4f16d816196 req-d63d5ce5-22fd-4abf-b229-c3f999ae3adf tempest-VolumesBackupsTest-787187355 None] attachment_update completed successfully.
Aug 06 21:22:56.606694 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] Calling backup continue_backup for: Backup(availability_zone=None,container=None,created_at=2022-08-06T21:22:56Z,data_timestamp=2022-08-06T21:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Backup-1297260220',encryption_key_id=None,fail_reason=None,host='ncdv-master-1',id=cd1b9193-5e37-476f-a098-530e4f4deb44,metadata={},num_dependent_backups=0,object_count=0,parent=None,parent_id=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',restore_volume_id=None,service='cinder.backup.drivers.ceph.CephBackupDriver',service_metadata=None,size=1,snapshot_id=None,status='creating',temp_snapshot_id=None,temp_volume_id=None,updated_at=None,user_id='e286c03134e646ce962ea7b88eab4b38',volume_id=dc7cec8b-4a90-4bae-8665-65bc2b7afa72)
Aug 06 21:22:56.607671 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.backup.rpcapi [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] continue_backup in rpcapi backup_id cd1b9193-5e37-476f-a098-530e4f4deb44 {{(pid=135688) continue_backup /opt/stack/cinder/cinder/backup/rpcapi.py:64}}
Aug 06 21:22:56.762468 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}
Aug 06 21:22:57.811369 ncdv-master-1 cinder-volume[135688]: DEBUG oslo_concurrency.processutils [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.049s {{(pid=135688) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}}
Aug 06 21:22:57.812433 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'hosts': ['10.222.0.33'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'fa12a965-1599-4278-8ea2-aa161374e763', 'volume_id': 'dc7cec8b-4a90-4bae-8665-65bc2b7afa72', 'discard': True}} {{(pid=135688) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1649}}
Aug 06 21:22:57.841308 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.manager [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] Initialize volume connection completed successfully.
Aug 06 21:22:59.363005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=135688) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:22:59.392281 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Flow 'volume_create_manager' (ad1a3116-4df5-47be-a321-4293878067b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:22:59.401983 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da60df03-e86e-48fe-8fd1-37fde2784096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:59.422198 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da60df03-e86e-48fe-8fd1-37fde2784096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-144969507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=dfc7a864-3048-4293-9bbb-ea53eb9a21d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48a90a98bcc6456086f39fb93c80b9fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:22:59Z,use_quota=True,user_id='072374854bee412d88926414a37f1c36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:59.430965 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf0eb6-d836-4933-be8c-af89c9baa41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:59.435904 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfbf0eb6-d836-4933-be8c-af89c9baa41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:59.441502 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe14aff-6a9a-4ae5-88e9-37105834a358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:59.556323 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe14aff-6a9a-4ae5-88e9-37105834a358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfc7a864-3048-4293-9bbb-ea53eb9a21d6', 'volume_name': 'volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4759fff1f0>}' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:59.561824 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda317e4-e66f-4e1f-be27-fbb133b0cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:59.567055 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda317e4-e66f-4e1f-be27-fbb133b0cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:22:59.574718 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.manager [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2b9b66-387f-410b-9987-a45e5e7e0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=135688) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:22:59.576744 ncdv-master-1 cinder-volume[135688]: INFO cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Volume dfc7a864-3048-4293-9bbb-ea53eb9a21d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f4759fff1f0>}
Aug 06 21:22:59.577635 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Cloning dfc7a864-3048-4293-9bbb-ea53eb9a21d6 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=135688) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:22:59.578723 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:22:59.589915 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:22:59.609302 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 22, 59, 598084)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:22:59.610307 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:22:59.611005 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:22:59.623662 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.coordination [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=135688) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:22:59.624932 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:22:59.637656 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 22, 59, 629320)}. {{(pid=135688) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:22:59.640039 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.image.cache [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=135688) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:22:59.643132 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.flows.manager.create_volume [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=135688) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:22:59.681015 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=135688) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:22:59.774276 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] creating snapshot='volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6.clone_snap' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:23:00.134659 ncdv-master-1 cinder-volume[135688]: DEBUG cinder.volume.drivers.rbd [None req-861ee96a-81da-4672-859f-aa449ae1dc3a tempest-TestVolumeBackupRestore-1739106376 None] cloning 'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7@volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6.clone_snap' to 'volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6' {{(pid=135688) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:785}}
Aug 06 21:23:00.320008 ncdv-master-1 cinder-volume[135688]: terminate called after throwing an instance of 'std::system_error'
Aug 06 21:23:00.337505 ncdv-master-1 cinder-volume[135688]:   what():  Invalid argument
Aug 06 21:23:00.375255 ncdv-master-1 cinder-volume[135515]: INFO oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Child 135688 killed by signal 6
Aug 06 21:23:00.381031 ncdv-master-1 cinder-volume[135515]: DEBUG oslo_service.service [None req-4996b777-9f10-4796-9279-9980b257b25b None None] Started child 180866 {{(pid=135515) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}}
Aug 06 21:23:00.399651 ncdv-master-1 cinder-volume[180866]: INFO cinder.service [-] Starting cinder-volume node (version 20.1.0)
Aug 06 21:23:00.566062 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Starting volume driver RBDDriver (1.2.0)
Aug 06 21:23:00.575464 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:00.635252 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:00.730604 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:00.786293 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.driver [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Driver hasn't implemented _init_vendor_properties()
Aug 06 21:23:00.787083 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.driver [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.8, 'free_capacity_gb': 19.35, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:15ef9320-ebbb-4160-936f-b48823c40af2:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=180866) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:812}}
Aug 06 21:23:00.826490 ncdv-master-1 cinder-volume[180866]: DEBUG oslo_db.sqlalchemy.engines [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=180866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}}
Aug 06 21:23:00.830839 ncdv-master-1 cinder-volume[180866]: DEBUG dbcounter [-] [180866] Writer thread running {{(pid=180866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}}
Aug 06 21:23:00.895316 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.db.sqlalchemy.api [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Building query based on filter {{(pid=180866) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}}
Aug 06 21:23:00.972519 ncdv-master-1 cinder-volume[180866]: INFO cinder.keymgr.migration [None req-a9e2ccc8-80cc-4a2e-9095-679fb5cded1a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 06 21:23:00.975311 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:01.055153 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:01.141127 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Notifying Schedulers of capabilities ... {{(pid=180866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:23:01.207660 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Driver initialization completed successfully.
Aug 06 21:23:01.208962 ncdv-master-1 cinder-volume[180866]: INFO cinder.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Initiating service 3 cleanup
Aug 06 21:23:01.318001 ncdv-master-1 cinder-volume[180866]: INFO cinder.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Cleaning Volume with id dfc7a864-3048-4293-9bbb-ea53eb9a21d6 and status creating
Aug 06 21:23:01.358007 ncdv-master-1 cinder-volume[180866]: INFO cinder.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Service 3 cleanup completed.
Aug 06 21:23:01.358455 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.service [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Creating RPC server for service cinder-volume {{(pid=180866) start /opt/stack/cinder/cinder/service.py:238}}
Aug 06 21:23:01.381736 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.service [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=180866) start /opt/stack/cinder/cinder/service.py:244}}
Aug 06 21:23:01.441493 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0)
Aug 06 21:23:01.443183 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:01.520949 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:01.613394 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-f0012b2d-5041-444e-b042-95097f73e7e8 None None] Driver post RPC initialization completed successfully.
Aug 06 21:23:01.699710 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] Terminate volume connection completed successfully.
Aug 06 21:23:01.728475 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-3f8c9eed-6ca7-42ea-9592-1f090b45b4b1 tempest-VolumesBackupsTest-787187355 None] Remove volume export completed successfully.
Aug 06 21:23:02.573556 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] Acquiring lock "cinder-dfc7a864-3048-4293-9bbb-ea53eb9a21d6-delete_volume" by "delete_volume" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:02.586025 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] Lock "cinder-dfc7a864-3048-4293-9bbb-ea53eb9a21d6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:02.636155 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:02.753152 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] volume has no backup snaps {{(pid=180866) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:23:02.770206 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] deleting rbd volume volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6 {{(pid=180866) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:23:03.158306 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] volume is a clone so cleaning references {{(pid=180866) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1346}}
Aug 06 21:23:03.197515 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] deleting parent snapshot volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6.clone_snap {{(pid=180866) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1239}}
Aug 06 21:23:29.823110 ncdv-master-1 cinder-volume[180866]: DEBUG dbcounter [-] [180866] Writing DB stats cinder:SELECT=16,cinder:UPDATE=2 {{(pid=180866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:23:29.823884 ncdv-master-1 cinder-volume[180866]: DEBUG dbcounter [-] [180866] Writing DB stats cinder:SELECT=17,cinder:DELETE=1,cinder:UPDATE=1 {{(pid=180866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:23:29.890997 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] Lock "cinder-dfc7a864-3048-4293-9bbb-ea53eb9a21d6-delete_volume" released by "delete_volume" :: held 27.305s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server [None req-a7bc8ad2-f7a1-4bdf-b3a5-e54e408a7a03 tempest-TestVolumeBackupRestore-1739106376 None] Exception during message handling: rbd.ReadOnlyImage: [errno 30] RBD read-only image (error removing snapshot b'volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, volume, *args, **kwargs)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 197, in _synchronized
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Aug 06 21:23:29.945357 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1042, in delete_volume
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     self._clear_db(volume, new_status)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     self.driver.delete_volume(volume)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 1348, in delete_volume
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     self._delete_clone_parent_refs(client, parent, parent_snap)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 1241, in _delete_clone_parent_refs
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     parent_rbd.remove_snap(parent_snap)
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3551, in rbd.Image.remove_snap
Aug 06 21:23:29.946643 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error removing snapshot b'volume-dfc7a864-3048-4293-9bbb-ea53eb9a21d6.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:29.947919 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:29.949166 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [req-72863296-6c35-4347-870f-1cf42642930c req-f367db52-c074-48cb-85a5-09105bb24f05 tempest-VolumesBackupsTest-787187355 None] Terminate volume connection completed successfully.
Aug 06 21:23:29.949634 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [req-72863296-6c35-4347-870f-1cf42642930c req-f367db52-c074-48cb-85a5-09105bb24f05 tempest-VolumesBackupsTest-787187355 None] Deleting attachment 041ed59a-6ebf-4f0d-bc3b-6d3141cdfe55. {{(pid=180866) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4998}}
Aug 06 21:23:34.616890 ncdv-master-1 cinder-volume[180866]: DEBUG oslo_service.periodic_task [None req-3d42adff-3980-4f4b-954d-6052c36e64fa None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=180866) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}}
Aug 06 21:23:34.617748 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-3d42adff-3980-4f4b-954d-6052c36e64fa None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:34.726745 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-3d42adff-3980-4f4b-954d-6052c36e64fa None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:34.853644 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.manager [None req-3d42adff-3980-4f4b-954d-6052c36e64fa None None] Notifying Schedulers of capabilities ... {{(pid=180866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:23:35.170810 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Acquiring lock "cinder-f5adaf89-1512-4f7e-9904-46f75cd0794e-delete_volume" by "delete_volume" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:35.218946 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Lock "cinder-f5adaf89-1512-4f7e-9904-46f75cd0794e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:35.325735 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:35.450714 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] volume has no backup snaps {{(pid=180866) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:23:35.455378 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume volume-f5adaf89-1512-4f7e-9904-46f75cd0794e is not a clone. {{(pid=180866) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:23:35.470870 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] deleting rbd volume volume-f5adaf89-1512-4f7e-9904-46f75cd0794e {{(pid=180866) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:23:35.903526 ncdv-master-1 cinder-volume[180866]: WARNING cinder.quota [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:23:35.905191 ncdv-master-1 cinder-volume[180866]: WARNING cinder.quota [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota.
Aug 06 21:23:35.936950 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.quota [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Created reservations ['edf77ef2-8fcd-4b67-8c36-8a6943fec4dc', 'a164f965-8566-4892-82f0-7ceb2935ec18', '1514e38f-9d16-4d73-baf8-d28a7ffe95e8', '976c7a89-8fcd-48a2-938c-2f0355c8f034'] {{(pid=180866) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:23:36.081485 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:36.136390 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:36.199117 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.manager [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Notifying Schedulers of capabilities ... {{(pid=180866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:23:36.204659 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Deleted volume successfully.
Aug 06 21:23:36.228744 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-119577bd-6e39-4e39-ac8c-138c1a463ba4 tempest-AttachVolumeShelveTestJSON-1443103339 None] Lock "cinder-f5adaf89-1512-4f7e-9904-46f75cd0794e-delete_volume" released by "delete_volume" :: held 1.010s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:36.596156 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Acquiring lock "cinder-2ff735e5-1c13-4f4b-a375-3a73824d0945-delete_volume" by "delete_volume" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:36.608283 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Lock "cinder-2ff735e5-1c13-4f4b-a375-3a73824d0945-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:36.668086 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:36.760052 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] volume has no backup snaps {{(pid=180866) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1173}}
Aug 06 21:23:36.760531 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Volume volume-2ff735e5-1c13-4f4b-a375-3a73824d0945 is not a clone. {{(pid=180866) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:23:36.770445 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] deleting rbd volume volume-2ff735e5-1c13-4f4b-a375-3a73824d0945 {{(pid=180866) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:23:37.071817 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.quota [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Created reservations ['0d4c7905-a4d6-4b40-96c2-a929088fd679', '92ffc56e-20f0-4abf-8e52-3f98f618f46c', 'a612d371-5bcf-4bf7-99aa-babff3062aff', 'e870d600-87c8-46d5-b6f1-92fdb187a01f'] {{(pid=180866) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:23:37.125310 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Acquiring lock "cinder-dc7cec8b-4a90-4bae-8665-65bc2b7afa72-delete_volume" by "delete_volume" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:37.145898 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-dc7cec8b-4a90-4bae-8665-65bc2b7afa72-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:37.205296 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:38.037900 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Volume volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72 is not a clone. {{(pid=180866) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1201}}
Aug 06 21:23:38.061836 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] deleting rbd volume volume-dc7cec8b-4a90-4bae-8665-65bc2b7afa72 {{(pid=180866) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1325}}
Aug 06 21:23:38.083958 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:38.157057 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:38.277622 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.manager [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Notifying Schedulers of capabilities ... {{(pid=180866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:23:38.285698 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Deleted volume successfully.
Aug 06 21:23:38.315223 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-c8ab6d50-fac6-42fc-a115-6cf8936e9f7d tempest-AttachVolumeShelveTestJSON-1443103339 None] Lock "cinder-2ff735e5-1c13-4f4b-a375-3a73824d0945-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:38.488814 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.quota [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Created reservations ['5928e5fb-1895-48e1-ad31-37dd51ba29fd', 'f0b36e73-9640-4fd5-acaa-ad41cceadf85', '0cb367ba-5670-426b-949e-278296a32e70', 'cec150d4-5b06-4c66-a5b7-319b76131599'] {{(pid=180866) reserve /opt/stack/cinder/cinder/quota.py:755}}
Aug 06 21:23:38.619487 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:38.712049 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:38.763684 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.manager [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Notifying Schedulers of capabilities ... {{(pid=180866) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Aug 06 21:23:38.769896 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Deleted volume successfully.
Aug 06 21:23:38.793240 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-d91df98f-48b6-47aa-8052-9df5b1c83ea0 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-dc7cec8b-4a90-4bae-8665-65bc2b7afa72-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:40.243293 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=180866) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:23:40.482117 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (2cb3ffdd-851c-41a6-8143-1a48f364d223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:23:40.489890 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699e78f-f493-4532-b262-fd76e222409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:40.509573 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699e78f-f493-4532-b262-fd76e222409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:40.515211 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515b43f3-6d2f-424f-9f37-1a30c3b83d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:40.520046 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515b43f3-6d2f-424f-9f37-1a30c3b83d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:40.525923 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036cd70-48aa-4df2-ab38-5b6abd62987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:40.795951 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036cd70-48aa-4df2-ab38-5b6abd62987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475bacb970>}' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:40.801101 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c98a19a-48e3-4ec9-8aa7-3b3666c234f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:40.808376 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c98a19a-48e3-4ec9-8aa7-3b3666c234f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:40.818944 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05381b1b-2b3e-4d74-89b7-fec5b8003421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:40.820147 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475bacb970>}
Aug 06 21:23:40.820756 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Cloning 5dad89fe-833e-46a3-9b60-4a6636383219 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=180866) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:23:40.821557 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:40.842751 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.021s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:40.865720 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 40, 855209)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:40.867762 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:40.868504 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:23:40.881180 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.038s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:40.883042 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:23:40.896025 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 40, 889291)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:40.896601 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:40.897048 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:23:40.947368 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:41.041795 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] creating snapshot='volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' {{(pid=180866) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:23:41.104128 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05381b1b-2b3e-4d74-89b7-fec5b8003421) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 06 21:23:41.104128 ncdv-master-1 cinder-volume[180866]: 5 predecessors (most recent first):
Aug 06 21:23:41.104128 ncdv-master-1 cinder-volume[180866]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b910a60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': None}
Aug 06 21:23:41.104607 ncdv-master-1 cinder-volume[180866]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b910a60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475bacb970>}}
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'retry': {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']}, 'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'snapshot_id': None, 'source_volid': None, 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume': {'id': '5dad89fe-833e-46a3-9b60-4a6636383219', '_name_id': None, 'ec2_id': None, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-06T21:23:39.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'name_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'metadata': {}, 'qos_specs': None}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'context': <cinder.context.RequestContext object at 0x7f475b910a60>}, 'provides': None}
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b910a60>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:40Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return fut.result()
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return self.__get_result()
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     raise self._exception
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:41.105506 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:41.144011 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05381b1b-2b3e-4d74-89b7-fec5b8003421) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.160735 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05381b1b-2b3e-4d74-89b7-fec5b8003421) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:41.179274 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c98a19a-48e3-4ec9-8aa7-3b3666c234f7) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.186912 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c98a19a-48e3-4ec9-8aa7-3b3666c234f7) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:41.198193 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036cd70-48aa-4df2-ab38-5b6abd62987a) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.202341 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1036cd70-48aa-4df2-ab38-5b6abd62987a) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:41.240100 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515b43f3-6d2f-424f-9f37-1a30c3b83d06) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.241540 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Updating volume 5dad89fe-833e-46a3-9b60-4a6636383219 with {'scheduled_at': datetime.datetime(2022, 8, 6, 21, 23, 41, 241139), 'host': None}. {{(pid=180866) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 06 21:23:41.258469 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduling SchedulerAPI.create_volume attempt 1 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap') {{(pid=180866) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 06 21:23:41.311636 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduled {{(pid=180866) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 06 21:23:41.312310 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:41.418206 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] volume volume-5dad89fe-833e-46a3-9b60-4a6636383219 no longer exists in backend
Aug 06 21:23:41.439034 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515b43f3-6d2f-424f-9f37-1a30c3b83d06) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 06 21:23:41.447529 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699e78f-f493-4532-b262-fd76e222409b) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.456362 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699e78f-f493-4532-b262-fd76e222409b) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:41.471818 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (2cb3ffdd-851c-41a6-8143-1a48f364d223) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise value
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:41.492922 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:41.553008 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume reschedule parameters: True retry: {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']} {{(pid=180866) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:23:41.606776 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (386194bf-b985-4d1f-bd3c-e6c42b58d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:23:41.620738 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b0046-801a-4dbd-aff8-741a15253691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.681338 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b0046-801a-4dbd-aff8-741a15253691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:41.687846 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483af6e-866d-4306-bd64-e5bbd77f57d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.694417 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483af6e-866d-4306-bd64-e5bbd77f57d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:41.701085 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a6466-4d32-4175-beeb-f765eb67131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.830807 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a6466-4d32-4175-beeb-f765eb67131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b738250>}' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:41.836210 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208fcbca-fee3-4112-9288-a38fb671adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.854663 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208fcbca-fee3-4112-9288-a38fb671adfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:41.865551 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf4da0-a860-42f9-8cdd-712f8aeb2ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:41.866507 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b738250>}
Aug 06 21:23:41.867106 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Cloning 5dad89fe-833e-46a3-9b60-4a6636383219 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=180866) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:23:41.867874 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:41.884308 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.016s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:41.902657 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 41, 890603)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:41.903090 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:41.903624 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:23:41.909035 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.025s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:41.909731 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:23:41.922872 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 41, 917008)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:41.925176 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:41.926132 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:23:41.954777 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:42.079580 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] creating snapshot='volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' {{(pid=180866) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf4da0-a860-42f9-8cdd-712f8aeb2ba8) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]: 5 predecessors (most recent first):
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b7385b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': None}
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b7385b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b738250>}}
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'snapshot_id': None, 'source_volid': None, 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume': {'id': '5dad89fe-833e-46a3-9b60-4a6636383219', '_name_id': None, 'ec2_id': None, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-06T21:23:39.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'name_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 2, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'context': <cinder.context.RequestContext object at 0x7f475b7385b0>}, 'provides': None}
Aug 06 21:23:42.117561 ncdv-master-1 cinder-volume[180866]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b7385b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:41Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return fut.result()
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return self.__get_result()
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     raise self._exception
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:42.118286 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:42.151287 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf4da0-a860-42f9-8cdd-712f8aeb2ba8) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.166879 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf4da0-a860-42f9-8cdd-712f8aeb2ba8) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:42.182227 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208fcbca-fee3-4112-9288-a38fb671adfa) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.191638 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208fcbca-fee3-4112-9288-a38fb671adfa) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:42.209617 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a6466-4d32-4175-beeb-f765eb67131d) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.221953 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973a6466-4d32-4175-beeb-f765eb67131d) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:42.233790 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483af6e-866d-4306-bd64-e5bbd77f57d8) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.239569 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Updating volume 5dad89fe-833e-46a3-9b60-4a6636383219 with {'scheduled_at': datetime.datetime(2022, 8, 6, 21, 23, 42, 237221), 'host': None}. {{(pid=180866) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 06 21:23:42.265997 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduling SchedulerAPI.create_volume attempt 2 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap') {{(pid=180866) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 06 21:23:42.322978 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduled {{(pid=180866) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 06 21:23:42.323647 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:42.411014 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] volume volume-5dad89fe-833e-46a3-9b60-4a6636383219 no longer exists in backend
Aug 06 21:23:42.428463 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a483af6e-866d-4306-bd64-e5bbd77f57d8) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 06 21:23:42.436766 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b0046-801a-4dbd-aff8-741a15253691) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.449554 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68b0046-801a-4dbd-aff8-741a15253691) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:42.455283 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (386194bf-b985-4d1f-bd3c-e6c42b58d33a) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise value
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:42.457995 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:42.611814 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume reschedule parameters: True retry: {'num_attempts': 3, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']} {{(pid=180866) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:23:42.639322 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (c7e25a68-331d-46df-86ae-e6c2e9ed91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:23:42.654192 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6665c38-cbf4-4e84-a638-6771c29d529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.671680 ncdv-master-1 cinder-volume[180866]: DEBUG dbcounter [-] [180866] Writing DB stats cinder:SELECT=59,cinder:UPDATE=33,cinder:DELETE=3,cinder:INSERT=5 {{(pid=180866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:23:42.677366 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6665c38-cbf4-4e84-a638-6771c29d529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.683987 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905c647-5b36-45a6-9076-daea9271832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.689694 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905c647-5b36-45a6-9076-daea9271832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.697766 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd2524-90f1-443c-9783-df5d1705fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.723485 ncdv-master-1 cinder-volume[180866]: DEBUG dbcounter [-] [180866] Writing DB stats cinder:SELECT=61,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=180866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}
Aug 06 21:23:42.732027 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=180866) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1366}}
Aug 06 21:23:42.752792 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Flow 'volume_create_manager' (1e479905-4587-4cf9-9404-96c7a2183a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:23:42.761650 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bd3743-59ca-4589-9b62-829734f77d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.789779 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bd3743-59ca-4589-9b62-829734f77d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1178097325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=561eca4f-cd63-41fb-84c1-1a34ec519bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ff5cf7fb11b4fc8aab84c3610683094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='28aa42b542db43a1bf3d1d21d687b95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.795994 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc8b52-8725-480b-92f6-3ac9010554e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.800985 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dc8b52-8725-480b-92f6-3ac9010554e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.807160 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7058d87b-0343-4fbd-b1dd-7096dfc5a72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.819631 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7058d87b-0343-4fbd-b1dd-7096dfc5a72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '561eca4f-cd63-41fb-84c1-1a34ec519bca', 'volume_name': 'volume-561eca4f-cd63-41fb-84c1-1a34ec519bca', 'volume_size': 1}' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.837366 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e757b42d-f35b-4b99-b737-6280d200b6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.841836 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e757b42d-f35b-4b99-b737-6280d200b6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:42.847788 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5d7977-8284-4322-a7b5-2f09f7a2f2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:42.851111 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.flows.manager.create_volume [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Volume 561eca4f-cd63-41fb-84c1-1a34ec519bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-561eca4f-cd63-41fb-84c1-1a34ec519bca', 'volume_size': 1}
Aug 06 21:23:42.854590 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] creating volume 'volume-561eca4f-cd63-41fb-84c1-1a34ec519bca' {{(pid=180866) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1040}}
Aug 06 21:23:42.854590 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:43.002772 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=180866) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:915}}
Aug 06 21:23:43.003266 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=180866) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:924}}
Aug 06 21:23:43.008986 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5d7977-8284-4322-a7b5-2f09f7a2f2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-561eca4f-cd63-41fb-84c1-1a34ec519bca', 'volume_size': 1}' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:43.015755 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764743c4-bcb1-4c8a-80c1-9032d76f0f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.044798 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.flows.manager.create_volume [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Volume volume-561eca4f-cd63-41fb-84c1-1a34ec519bca (561eca4f-cd63-41fb-84c1-1a34ec519bca): created successfully
Aug 06 21:23:43.051628 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764743c4-bcb1-4c8a-80c1-9032d76f0f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:43.062052 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Flow 'volume_create_manager' (1e479905-4587-4cf9-9404-96c7a2183a3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=180866) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}}
Aug 06 21:23:43.076901 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd2524-90f1-443c-9783-df5d1705fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b63eb50>}' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:43.084607 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b36125-8c34-4335-be6a-8796b79205b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.097074 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b36125-8c34-4335-be6a-8796b79205b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}}
Aug 06 21:23:43.103580 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddba9c8-53bd-418d-bdb5-ab55136cfb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.106303 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b63eb50>}
Aug 06 21:23:43.107045 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Cloning 5dad89fe-833e-46a3-9b60-4a6636383219 from image 5135514a-af3f-4057-893c-38dd4d85e4cd  at location (None, None). {{(pid=180866) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1069}}
Aug 06 21:23:43.107695 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Acquiring lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" by "_prepare_image_cache_entry" {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:192}}
Aug 06 21:23:43.142740 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" acquired by "_prepare_image_cache_entry" :: waited 0.034s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:195}}
Aug 06 21:23:43.151834 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.manager [None req-069dc49a-41f7-4fc5-bd5b-920229bcab80 tempest-AttachVolumeTestJSON-441755749 None] Created volume successfully.
Aug 06 21:23:43.182794 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 43, 164794)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:43.183235 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:43.184140 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:884}}
Aug 06 21:23:43.189954 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.coordination [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Lock "cinder-5135514a-af3f-4057-893c-38dd4d85e4cd" released by "_prepare_image_cache_entry" :: held 0.048s {{(pid=180866) _synchronized /opt/stack/cinder/cinder/coordination.py:204}}
Aug 06 21:23:43.190698 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Attempting to retrieve cache entry for image = 5135514a-af3f-4057-893c-38dd4d85e4cd on host ncdv-master-1@ceph#ceph. {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}}
Aug 06 21:23:43.211680 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Found image-volume cache entry: {'id': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'volume_id': '6d97c949-ba9a-43cc-9a74-fa93d03d5db7', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23), 'last_used': datetime.datetime(2022, 8, 6, 21, 23, 43, 199513)}. {{(pid=180866) get_entry /opt/stack/cinder/cinder/image/cache.py:76}}
Aug 06 21:23:43.212109 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.image.cache [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Image-volume cache entry image_update_at = 2022-08-06 20:45:23+00:00, requested image updated_at = 2022-08-06 20:45:23+00:00. {{(pid=180866) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}}
Aug 06 21:23:43.223042 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Creating from source image-volume 6d97c949-ba9a-43cc-9a74-fa93d03d5db7 {{(pid=180866) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:839}}
Aug 06 21:23:43.256570 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:43.353449 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] creating snapshot='volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' {{(pid=180866) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:779}}
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddba9c8-53bd-418d-bdb5-ab55136cfb62) transitioned into state 'FAILURE' from state 'RUNNING'
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]: 5 predecessors (most recent first):
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]:   Atom 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b738b80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': None}
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]:   |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b738b80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b))}, 'provides': {'status': 'creating', 'type': 'image', 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_size': 1, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '39f3affb323c4555adb3a84fee8265cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'created_at': datetime.datetime(2022, 8, 6, 20, 45, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2022, 8, 6, 20, 45, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5135514a-af3f-4057-893c-38dd4d85e4cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f475b63eb50>}}
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]:      |__Atom 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'filter_properties': {'request_spec': {'consistencygroup_id': None, 'group_id': None, 'cgsnapshot_id': None, 'image_id': '5135514a-af3f-4057-893c-38dd4d85e4cd', 'snapshot_id': None, 'source_volid': None, 'volume_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume': {'id': '5dad89fe-833e-46a3-9b60-4a6636383219', '_name_id': None, 'ec2_id': None, 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'use_quota': True, 'snapshot_id': None, 'cluster_name': None, 'host': None, 'size': 1, 'availability_zone': 'nova', 'status': 'creating', 'attach_status': 'detached', 'migration_status': None, 'scheduled_at': None, 'launched_at': None, 'terminated_at': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'display_description': None, 'provider_id': None, 'provider_location': None, 'provider_auth': None, 'provider_geometry': None, 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'source_volid': None, 'encryption_key_id': None, 'consistencygroup_id': None, 'group_id': None, 'deleted': False, 'bootable': False, 'multiattach': False, 'replication_status': None, 'replication_extended_status': None, 'replication_driver_data': None, 'previous_status': None, 'metadata': {}, 'admin_metadata': {}, 'glance_metadata': {}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_attachment': [], 'service_uuid': None, 'shared_targets': True, 'created_at': '2022-08-06T21:23:39.000000', 'updated_at': None, 'deleted_at': None, 'name': 'volume-5dad89fe-833e-46a3-9b60-4a6636383219', 'name_id': '5dad89fe-833e-46a3-9b60-4a6636383219', 'volume_metadata': [], 'volume_admin_metadata': [], 'volume_glance_metadata': []}, 'volume_type': {'id': '609504bb-95af-40f6-9ecd-e37af5ddd75b', 'name': 'ceph', 'description': None, 'is_public': True, 'projects': [], 'extra_specs': {'volume_backend_name': 'ceph'}, 'qos_specs_id': None, 'created_at': '2022-08-06T20:44:51.000000', 'updated_at': None, 'deleted_at': None, 'deleted': False}, 'volume_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}, 'backup_id': None, 'availability_zones': ['nova'], 'resource_properties': {'attach_status': 'detached', 'availability_zone': 'nova', 'cgsnapshot_id': None, 'consistencygroup_id': None, 'group_id': None, 'display_description': None, 'display_name': 'tempest-VolumesBackupsTest-Volume-1300060742', 'encryption_key_id': None, 'metadata': {}, 'multiattach': False, 'project_id': 'a31b7575aa0944cca8da8f093eeeb0bf', 'qos_specs': None, 'reservations': ['a3a5eeec-17a8-4051-92dd-e640cdac25c4', '101c5f6b-fe7e-43e5-86f3-7e26c5a2427b', '2e203a22-dd23-4e44-856d-563675826211', 'b6b6949e-c260-4ea9-b715-60b4a5c918b0'], 'size': 1, 'snapshot_id': None, 'source_volid': None, 'status': 'creating', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'volume_type_id': '609504bb-95af-40f6-9ecd-e37af5ddd75b'}}, 'config_options': {}, 'volume_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'resource_type': VolumeType(created_at=2022-08-06T20:44:51Z,deleted=False,deleted_at=None,description=None,extra_specs={volume_backend_name='ceph'},id=609504bb-95af-40f6-9ecd-e37af5ddd75b,is_public=True,name='ceph',projects=[],qos_specs=<?>,qos_specs_id=None,updated_at=None), 'size': 1, 'availability_zone': 'nova', 'user_id': 'e286c03134e646ce962ea7b88eab4b38', 'metadata': {}, 'qos_specs': None, 'retry': {'num_attempts': 3, 'backends': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph', 'ncdv-master-1@ceph#ceph']}}, 'request_spec': RequestSpec(CG_backend=<?>,availability_zones=['nova'],backup_id=None,cgsnapshot_id=None,consistencygroup_id=None,group_backend=<?>,group_id=None,image_id=5135514a-af3f-4057-893c-38dd4d85e4cd,operation=<?>,resource_backend=<?>,snapshot_id=None,source_replicaid=<?>,source_volid=None,volume=Volume(5dad89fe-833e-46a3-9b60-4a6636383219),volume_id=5dad89fe-833e-46a3-9b60-4a6636383219,volume_properties=VolumeProperties,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b)), 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b), 'context': <cinder.context.RequestContext object at 0x7f475b738b80>}, 'provides': None}
Aug 06 21:23:43.390368 ncdv-master-1 cinder-volume[180866]:         |__Atom 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' {'intention': 'EXECUTE', 'state': 'SUCCESS', 'requires': {'context': <cinder.context.RequestContext object at 0x7f475b738b80>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}, 'provides': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2022-08-06T21:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1300060742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='ncdv-master-1@ceph#ceph',id=5dad89fe-833e-46a3-9b60-4a6636383219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a31b7575aa0944cca8da8f093eeeb0bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2022-08-06T21:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2022-08-06T21:23:43Z,use_quota=True,user_id='e286c03134e646ce962ea7b88eab4b38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(609504bb-95af-40f6-9ecd-e37af5ddd75b),volume_type_id=609504bb-95af-40f6-9ecd-e37af5ddd75b)}
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]:            |__Flow 'volume_create_manager': rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.create_snap(clone_snap)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager During handling of the above exception, another exception occurred:
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager Traceback (most recent call last):
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = task.execute(**arguments)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image(context,
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return r(f, *args, **kwargs)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     do = self.iter(retry_state=retry_state)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return fut.result()
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     return self.__get_result()
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     raise self._exception
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     result = fn(*args, **kwargs)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self._create_from_source_volume(
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:43.391217 ncdv-master-1 cinder-volume[180866]: ERROR cinder.volume.manager 
Aug 06 21:23:43.440019 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddba9c8-53bd-418d-bdb5-ab55136cfb62) transitioned into state 'REVERTING' from state 'FAILURE' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.445277 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddba9c8-53bd-418d-bdb5-ab55136cfb62) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:43.467468 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b36125-8c34-4335-be6a-8796b79205b3) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.497472 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b36125-8c34-4335-be6a-8796b79205b3) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:43.508027 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd2524-90f1-443c-9783-df5d1705fbe1) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.521470 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cd2524-90f1-443c-9783-df5d1705fbe1) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:43.538163 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905c647-5b36-45a6-9076-daea9271832d) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.539740 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Updating volume 5dad89fe-833e-46a3-9b60-4a6636383219 with {'scheduled_at': datetime.datetime(2022, 8, 6, 21, 23, 43, 539340), 'host': None}. {{(pid=180866) _pre_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:138}}
Aug 06 21:23:43.574788 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduling SchedulerAPI.create_volume attempt 3 due to [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap') {{(pid=180866) _reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:161}}
Aug 06 21:23:43.622688 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Volume 5dad89fe-833e-46a3-9b60-4a6636383219: re-scheduled {{(pid=180866) _post_reschedule /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:178}}
Aug 06 21:23:43.626845 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=180866) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:523}}
Aug 06 21:23:43.740689 ncdv-master-1 cinder-volume[180866]: INFO cinder.volume.drivers.rbd [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] volume volume-5dad89fe-833e-46a3-9b60-4a6636383219 no longer exists in backend
Aug 06 21:23:43.750071 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d905c647-5b36-45a6-9076-daea9271832d) transitioned into state 'REVERTED' from state 'REVERTING' with result 'True'
Aug 06 21:23:43.756558 ncdv-master-1 cinder-volume[180866]: DEBUG cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6665c38-cbf4-4e84-a638-6771c29d529f) transitioned into state 'REVERTING' from state 'SUCCESS' {{(pid=180866) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}}
Aug 06 21:23:43.763460 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6665c38-cbf4-4e84-a638-6771c29d529f) transitioned into state 'REVERTED' from state 'REVERTING' with result 'None'
Aug 06 21:23:43.769697 ncdv-master-1 cinder-volume[180866]: WARNING cinder.volume.manager [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Flow 'volume_create_manager' (c7e25a68-331d-46df-86ae-e6c2e9ed91fb) transitioned into state 'REVERTED' from state 'RUNNING'
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server [None req-17a5ab35-0207-47c3-8c48-8e3458b02771 tempest-VolumesBackupsTest-787187355 None] Exception during message handling: rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 782, in create_cloned_volume
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.create_snap(clone_snap)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3514, in rbd.Image.create_snap
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ReadOnlyImage: [errno 30] RBD read-only image (error creating snapshot b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap' from b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7')
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = f(*args, **kwargs)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 819, in create_volume
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     _run_flow()
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 811, in _run_flow
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     flow_engine.run()
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 247, in run
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     for _state in self.run_iter(timeout=timeout):
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/engine.py", line 340, in run_iter
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failure.Failure.reraise_if_any(er_failures)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 338, in reraise_if_any
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     failures[0].reraise()
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/types/failure.py", line 350, in reraise
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise value
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/taskflow/engines/action_engine/executor.py", line 52, in _execute_task
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = task.execute(**arguments)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1235, in execute
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image(context,
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/utils.py", line 669, in _wrapper
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return r(f, *args, **kwargs)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 423, in __call__
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     do = self.iter(retry_state=retry_state)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 360, in iter
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return fut.result()
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 437, in result
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     return self.__get_result()
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.8/concurrent/futures/_base.py", line 389, in __get_result
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     raise self._exception
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/usr/local/lib/python3.8/dist-packages/tenacity/__init__.py", line 426, in __call__
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     result = fn(*args, **kwargs)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 1123, in _create_from_image
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_image_cache_or_download(
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 942, in _create_from_image_cache_or_download
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update, cloned = self._create_from_image_cache(
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 841, in _create_from_image_cache
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self._create_from_source_volume(
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/flows/manager/create_volume.py", line 657, in _create_from_source_volume
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     model_update = self.driver.create_cloned_volume(volume, srcvol_ref)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/drivers/rbd.py", line 793, in create_cloned_volume
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server     src_volume.unprotect_snap(clone_snap)
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 2770, in rbd.requires_not_closed.wrapper
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server   File "rbd.pyx", line 3641, in rbd.Image.unprotect_snap
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server rbd.ImageNotFound: [errno 2] RBD image not found (error unprotecting snapshot b'volume-6d97c949-ba9a-43cc-9a74-fa93d03d5db7'@b'volume-5dad89fe-833e-46a3-9b60-4a6636383219.clone_snap')
Aug 06 21:23:43.780501 ncdv-master-1 cinder-volume[180866]: ERROR oslo_messaging.rpc.server 
Aug 06 21:23:44.431562 ncdv-master-1 cinder-volume[180866]: DEBUG oslo_concurrency.processutils [req-6013622f-e908-4a7f-bc13-e687b5f6d5cf req-ab8368a5-0c1c-406b-94c8-b63af95873d9 tempest-AttachVolumeTestJSON-441755749 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=180866) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}}